Sound output system or internet appliance that supports voice activated commands, and that plays audio data received from a service over a network

ABSTRACT

An output system, such as a wireless speaker or an Internet appliance, that supports voice activated commands is herein disclosed and enabled. The output system is wirelessly connectable to a service operated over a network (e.g., Internet) for receiving output data (e.g., music) from the service for outputting at the output system. The setup of the output system includes: (1) wirelessly discovering the output system using a smart phone, (2) establishing a wireless communication link between the smart phone and the output system (e.g., via Bluetooth or IEEE 802.11), and (3) providing information, such as security and/or authentication information, from the smart phone to the output system over the wireless communication link. Thereafter, the output system accesses the service operated over the network, and the outpt system is operabke to receive voice activated commands from a user while the output system is connected to the service.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.10/053,765 filed Jan. 18, 2002, which claims priority to U.S.Provisional Patent Application Ser. No. 60/262,764, filed Jan. 19, 2001.Additionally, this application is a continuation-in-part of U.S. patentapplication Ser. No. 09/992,413, filed Nov. 18, 2001, and which claimsbenefit of U.S. Provisional Patent Application Ser. No. 60/252,682,filed Nov. 20, 2000. Moreover, this application is acontinuation-in-part of U.S. patent application Ser. No. 13/710,299filed Dec. 10, 2012, which is a continuation of U.S. patent applicationSer. No. 12/903,048 filed Oct. 12, 2010, issued as U.S. Pat. No.8,332,521, which is a continuation of U.S. patent application Ser. No.10/016,223 filed Nov. 1, 2001, issued as U.S. Pat. No. 7,941,541, andwhich claims benefit of U.S. Provisional Patent Application Ser. No.60/245,101 filed Nov. 1, 2000. The complete disclosures of the abovepatent applications are hereby incorporated by reference for allpurposes.

TECHNICAL FIELD OF THE INVENTION

Present invention relates to providing content to an output device and,in particular, to providing universal output in which an informationapparatus can pervasively output content to an output device without theneed to install a dedicated device dependent driver or applications foreach output device.

BACKGROUND OF THE DISCLOSURE

The present invention relates to universal data output and, inparticular, to providing a new data output method and a new raster imageprocess for information apparatuses and output devices.

As described herein, information apparatuses refer generally tocomputing devices, which include both stationary computers and mobilecomputing devices (pervasive devices). Examples of such informationapparatuses include, without limitation, desktop computers, laptopcomputers, networked computers, palmtop computers (hand-held computers),personal digital assistants (PDAs), Internet enabled mobile phones,smart phones, pagers, digital capturing devices (e.g., digital camerasand video cameras), Internet appliances, e-books, information pads, anddigital or web pads. Output devices may include, without limitation, faxmachines, printers, copiers, image and/or video display devices (e.g.,televisions, monitors and projectors), and audio output devices.

For simplicity and convenience, hereafter, the following descriptionsmay refer to an output device as a printer and an output process asprinting. However, it should be understood that the term printer andprinting used in the discussion of present invention refer to oneembodiment used as a specific example to simplify the description of theinvention. The references to printer and printing used here are intendedto be applied or extended to the larger scope and definition of outputdevices and should not be construed as restricting the scope andpractice of present invention.

Fueled by an ever-increasing bandwidth, processing power, wirelessmobile devices, and wireless software applications, millions of usersare or will be creating, downloading, and transmitting content andinformation using their pervasive or mobile computing devices. As aresult, there is a need to allow users to conveniently output contentand information from their pervasive computing devices to any outputdevice. As an example, people need to directly and conveniently outputfrom their pervasive information apparatus, without depending onsynchronizing with a stationary computer (e.g., desktop personalcomputer) for printing.

To illustrate, a mobile worker at an airport receiving e-mail in hishand-held computer may want to walk up to a nearby printer or faxmachine to have his e-mail printed. In addition, the mobile worker mayalso want to print a copy of his to-do list, appointment book, businesscard, and his flight schedule from his mobile device. As anotherexample, a user visiting an e-commerce site using his mobile device maywant to print out transaction confirmation. In still another example, auser who takes a picture with a digital camera may want to easily printit out to a nearby printer. In any of the above cases, the mobile usermay want to simply walk up to a printer and conveniently print a file(word processing document, PDF, HTML etc) that is stored on the mobiledevice or downloaded from a network (e.g., Internet, corporate network).

Conventionally, an output device (e.g., a printer) is connected to aninformation apparatus via a wired connection such as a cable line. Awireless connection is also possible by using, for example, radiocommunication or infrared communication. Regardless of wired or wirelessconnection, a user must first install in the information apparatus anoutput device driver (e.g., printer driver in the case the output deviceis a printer) corresponding to a particular output device model andmake. Using a device-dependent or specific driver, the informationapparatus may process output content or digital document into a specificoutput device's input requirements (e.g., printer input requirements).The output device's input requirements correspond to the type of inputthat the output device (e.g., a printer) understands. For example, aprinter's input requirement may include printer specific input format(e.g., one or more of an image, graphics or text format or language).Therefore, an output data (or print data in the case the output deviceis a printer) herein refers to data that is acceptable for input to anassociated output device. Examples of input requirements may include,without limitation, audio format, video format, file format, dataformat, encoding, language (e.g., page description language, markuplanguage etc), instructions, protocols or data that can be understood orused by a particular output device make and model.

Input requirements may be based on proprietary or published standards ora combination of the two. An output device's input requirements are,therefore, in general, device dependent. Different output device modelsmay have their own input requirements specified, designed or adopted bythe output device manufacturer (e.g., the printer manufacturer)according to a specification for optimal operation. Consequently,different output devices usually require use of specific output devicedrivers (e.g., printer drivers) for accurate output (e.g., printing).Sometimes, instead of using a device driver (e.g., printer driver), thedevice driving feature may be included as part of an applicationsoftware.

Installation of a device driver (e.g., printer driver) or applicationmay be accomplished by, for example, manual installation using a CD orfloppy disk supplied by the printer manufacturer. Or alternatively, auser may be able to download a particular driver or application from anetwork. For a home or office user, this installation process may takeanywhere from several minutes to several hours depending on the type ofdriver and user's sophistication level with computing devices andnetworks. Even with plug-and-play driver installation, the user is stillrequired to execute a multi-step process for each printer or outputdevice.

This installation and configuration process adds a degree of complexityand work to end-users who may otherwise spend their time doing otherproductive or enjoyable work. Moreover, many unsophisticated users maybe discouraged from adding new peripherals (e.g., printers, scanners,etc.) to their home computers or networks to avoid the inconvenience ofinstallation and configuration. It is therefore desirable that aninformation apparatus can output to more than one output device withoutthe inconvenience of installing multiple dedicated device dependentdrivers.

In addition, conventional output or printing methods may posesignificantly higher challenges and difficulties for mobile device usersthan for home and office users. The requirement for pre-installation ofa device-dependent driver diminishes the benefit and concept of mobile(pervasive) computing and output. For example, a mobile user may want toprint or output e-mail, PowerPoint® presentation documents, web pages,or other documents at an airport, gas station, convenience store, kiosk,hotel, conference room, office, home, etc. It is highly unlikely thatthe user would find at any of these locations a printer of the same makeand model as is at the user's base station. As a consequence, under theconventional printing method, the user would have to install andconfigure a printer driver each time at each such remote location beforeprinting. It is usually not a viable option given the hundreds, or eventhousands of printer models in use, and the limited storage, memoryspace, and processing power of the information apparatus.

Moreover, the user may not want to be bothered with looking for a driveror downloading it and installing it just to print out or display onepage of email at the airport. This is certainly an undesirable anddiscouraging process to promote pervasive or mobile computing.Therefore, a more convenient printing method is needed in support of thepervasive computing paradigm where a user can simply walk up to anoutput device (e.g., printer or display device) and easily output adigital document without having to install or pre-install a particularoutput device driver (e.g., printer driver).

Another challenge for mobile users is that many mobile informationapparatuses have limited memory space, processing capacity and power.These limitations are more apparent for small and low-cost mobiledevices including, for example, PDAs, mobile phones, screen phones,pagers, e-books, Internet Pads, Internet appliances etc. Limited memoryspace poses difficulties in installing and running large or complexprinter or device drivers, not to mention multiple drivers for a varietyof printers and output devices. Slow processing speed and limited powersupply create difficulties driving an output device. For example,processing or converting a digital document into output data by a smallmobile information apparatus may be so slow that it is not suitable forproductive output. Intensive processing may also drain or consume poweror battery resources. Therefore, a method is needed so that a smallmobile device, with limited processing capabilities, can stillreasonably output content to various output devices.

To output or render content (e.g. digital document) to an output device,a raster image processing (RIP) operation on the content is usuallyrequired. RIP operation can be computationally intensive and may include(1) a rasterization operation, (2) a color space conversion, and (3) ahalftoning operation. RIP may also include other operations such asscaling, segmentation, color matching, color correction, GCR (Greycomponent replacement), Black generation, image enhancementcompression/decompression, encoding/decoding, encryption/decryption GCR,image enhancement among others.

Rasterization operation in RIP involves converting objects anddescriptions (e.g. graphics, text etc) included in the content into animage form suitable for output. Rasterization may include additionaloperations such as scaling and interpolation operations for matching aspecific output size and resolution. Color space conversion in RIPincludes converting an input color space description into a suitablecolor space required for rendering at an output device (e.g. RGB to CMYKconversion). Digital halftoning is an imaging technique for renderingcontinuous tone images using fewer luminance and chrominance levels.Halftoning operations such as error diffusion can be computationallyintensive and are included when the output device's bit depth (e.g. bitsper pixel) is smaller than the input raster image bit depth.

Conventionally, RIP operations are included either in an informationapparatus, or as part of an output device or output system (e.g. in aprinter controller). FIG. 1A illustrates a flow diagram of aconventional data output method 102 in which RIP 110 is implemented inthe information apparatus. Output devices that do not include a printercontroller to perform complex RIP operations, such as a lower-cost,lower speed inkjet printer, normally employ data output method 102. Indata output method 102, an information apparatus obtains content (e.g. adigital document) in step 100 for rendering or output at an outputdevice. The information apparatus may includes an application (e.g.device driver), which implements RIP operation 110. The informationapparatus generates an output data in step 120 and transmits the outputdata to the output device in step 130 for rendering. The output datarelating to the content is in an acceptable form (e.g. in an appropriateoutput size and resolution) to the output engine (e.g. display engine,printer engine etc.) included in the output device. The output data in aconventional output method 102 is usually device dependent.

One drawback for the data output method 102 of FIG. 1A is that theinformation apparatus performs most if not the entire raster imageprocessing operations 110 required for output. The RIP operations mayrequire intensive computation. Many information apparatus such as mobileinformation device might have insufficient computing power and/or memoryto carry out at an acceptable speed the RIP operations 110 required inan output process.

Another drawback for the conventional data output method 102 of FIG. 1Ais that the generated output data is device dependent and therefore istypically not very portable to other output devices. As a result, theinformation apparatus may need to install multiple applications ordevice drivers for multiple output devices, which may further complicateits feasibility for use in information apparatuses with limited memory,storage and processing power.

FIG. 1B illustrates a flow diagram of another conventional data outputmethod 104 in which the RIP is implemented in an output device. Anexample of an output device that implements process 104 is a high-speedlaser printer which includes a printer controller for performing RIPoperations and an output engine (e.g. printer engine) for renderingcontent. Printer controller may be internally installed or externallyconnected to an output device (printer in this example). In data outputmethod 104, an information apparatus obtains content for output in step100 and generates in step 160 an output data or print data fortransmitting to the output device in step 170. Print data includesinformation related to the content and is usually encoded in a pagedescription language (PDL) such as PostScript and PCL etc. In step 180,the printer receives the output data or print data (in a PDL). In step190, a printer controller included in the printer interprets the PDL,performs RIP operations, and generates a printer-engine print data thatis in a form acceptable to the printer engine (e.g. a raster image in anappropriate output size, bit depth, color space and resolution). In step150 the printer engine renders the content with the printer-engine printdata.

It will be understood that a reference to print data or output dataincluding a language, such as PDL, should be interpreted as meaning thatthe print data or output data is encoded using that language.Correspondingly, a reference to a data output process generating alanguage, such as PDL, should be interpreted as meaning that the dataoutput process encodes data using that language.

There are many drawbacks in the conventional data output method 104shown in FIG. 1B. These drawbacks are especially apparent for mobilecomputing devices with limited processing power and memory. One suchdrawback is that the output data or print data, which include a pagedescription language (PDL) such as PostScript or PCL, can be verycomplex. Generating complex PDL may increase memory and processingrequirements for an information apparatus. Furthermore, interpreting,decoding and then raster image processing complex PDL can increasecomputation, decrease printing speed, and increase the cost of theoutput device or its printer controller.

Another drawback is that the output data that includes PDL can creates avery large file size that would increase memory and storage requirementsfor the information apparatus, the output device and/or the printercontroller etc. Large file size may also increase the bandwidth requiredin the communication link between the information apparatus and theoutput device.

Finally, to rasterize text in an output device, a printer controller mayneed to include multiple fonts. When a special font or internationalcharacters is not included or missing in the printer controller, therendering or output can potentially become inaccurate or inconsistent.

SUMMARY OF THE INVENTION

Accordingly, this invention provides a convenient universal data outputmethod in which an information apparatus and an output device or systemshare the raster image processing operations. Moreover, the new dataoutput method eliminates the need to install a plurality ofdevice-dependent dedicated drivers or applications in the informationapparatus in order to output to a plurality of output devices.

In accordance with present invention, an electronic system and method ofpervasive and universal output allow an information apparatus to outputcontent conveniently to virtually any output device. The informationapparatus may be equipped with a central processing unit, input/outputcontrol unit, storage unit, memory unit, and wired or wirelesscommunication unit or adapters. The information apparatus preferablyincludes a client application that may be implemented as a softwareapplication, a helper application, or a device driver (a printer driverin case of a printer). The client application may include management andcontrol capabilities with hardware and software components including,for example, one or more communication chipsets residing in its hostinformation apparatus.

The client application in the information apparatus may be capable ofcommunicating with, managing and synchronizing data or softwarecomponents with an output device equipped with an output controller ofpresent invention.

Rendering content in an output device refers to printing an image of thecontent onto an substrate in the case of a printing device; displayingan image of the content in the case of a displaying device; playing anaudio representation of the content in a voice or sound output device orsystem.

An output controller may be a circuit board, card or software componentsresiding in an output device. Alternatively, the output controller maybe connected externally to an output device as an external component or“box.” The output controller may be implemented with one or morecombinations of embedded processor, software, firmware, ASIC, DSP, FPGA,system on a chip, special chipsets, among others. In another embodiment,the functionality of the output controller may be provided byapplication software running on a PC, workstation or server connectedexternally to an output device.

In conventional data output method 102 as described with reference toFIG. 1A, an information apparatus transmits output data to an outputdevice for rendering. Output data corresponds to content intended foroutput and is mostly raster image processed (RIPed) and therefore isdevice dependent because raster image processing is a typical devicedependent operation. Output data may be encoded or compressed with oneor more compression or encoding techniques. In present invention, aninformation apparatus generates an intermediate output data fortransmitting to an output device. The intermediate output data includesa rasterized image corresponding to the content; however, devicedependent image processing operations of a RIP (e.g. color matching andhalftoning) have not been performed. As a result, an intermediate outputdata is more device independent and is more portable than the outputdata generated by output method with reference to FIG. 1A.

In one implementation of this invention, the intermediate output dataincludes MRC (Mixed raster content) format, encoding and compressiontechniques, which further provides improved image quality andcompression ratio compared to conventional image encoding andcompression techniques.

In an example of raster image process and data output method of thepresent invention, a client application such as a printer driver isincluded in an information apparatus and performs part of raster imageprocessing operation such as rasterization on the content. Theinformation apparatus generates an intermediate output data thatincludes an output image corresponding to the content and sends theintermediate output data to an output device or an output system forrendering. An output controller application or component included in theoutput device or output system implements the remaining part of theraster image processing operations such as digital halftoning, colorcorrection among others.

Unlike conventional raster image processing methods, this inventionprovides a more balanced distribution of the raster image processingcomputational load between the Information apparatus and the outputdevice or the output system. Computational intensive image processingoperations such as digital halftoning and color space conversions can beimplemented in the output device or output system. Consequently, thisnew raster image processing method reduces the processing and memoryrequirements for the information apparatus when compared to conventionaldata output methods described with reference to FIG. 1A in which theentire raster image process is implemented in the information apparatus.Additionally, in this invention, a client application or device driverincluded in the information apparatus, which performs part of the rasterimage processing operation, can have a smaller size compared to aconventional output application included in the information apparatus,which performs raster image processing operation.

In another implementation, the present invention provides an informationapparatus with output capability that is more universally accepted by aplurality of output devices. The information apparatus, which includes aclient application, generates an intermediate output data that mayinclude device independent attributes. An output controller includescomponents to interpret and process the intermediate output data. Theinformation apparatus can output content to different output devices oroutput systems that include the output controller even when those outputdevices are of different brand, make, model and with different outputengine and input data requirements. Unlike conventional output methods,a user does not need to preinstall in the information apparatus multiplededicated device dependent drivers or applications for each outputdevice.

The combination of a smaller-sized client application, a reducedcomputational requirement in the information apparatus, and a moreuniversal data output method acceptable for rendering at a plurality ofoutput devices enable mobile devices with less memory space andprocessing capabilities to implement data output functions whichotherwise would be difficulty to implement with conventional outputmethods.

In addition, this invention can reduce the cost of an output device oran output system compared to conventional output methods 104 thatinclude a page description language (PDL) printer controller. In thepresent invention, an information apparatus generates and sends anintermediate output data to an output device or system. The intermediateoutput data in one preferred embodiment includes a rasterized outputimage corresponding to the content intended for output. An outputcontroller included in an output device or an output system decodes andprocesses the intermediate output data for output, without performingcomplex interpretation and rasterization compared to conventionalmethods described in process 104. In comparison, the conventional dataoutput process 104 generates complex PDL and sends this PDL from aninformation apparatus to an output device that includes a printercontroller (e.g. a PostScript controller or a PCL5 controller amongothers). Interpretation and raster image processing of a PDL have muchhigher computational requirements compared to decoding and processingthe intermediate output data of this invention that include rasterizedoutput image or images. Implementing a conventional printer controllerwith, for example, PDL increases component cost (e.g. memories,storages, ICs, software and processors etc.) when compared to using theoutput controller included in the data output method of this presentinvention.

Furthermore, an output data that includes PDL can create a large filesize compared to an intermediate output data that includes rasterizedoutput image. The data output method for this invention comparativelytransmits a smaller output data from an information apparatus to anoutput device. Smaller output data size can speed up transmission, lowercommunication bandwidth, and reduce memory requirements. Finally, thisinvention can provide a convenient method to render content at an outputdevice with or without connection to a static network. In conventionalnetwork printing, both information apparatus and output device must beconnected to a static network. In this invention, through localcommunication and synchronization between an information apparatus andan output device, installation of hardware and software to maintainstatic network connectivity may not be necessary to enable the renderingof content to an output device.

According to the several aspects of the present invention there isprovided the subject matter defined in the appended independent claims.

Additional objects and advantages of the present invention will beapparent from the detailed description of the preferred embodimentthereof, which proceeds with reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A is a flow diagram of a conventional data output method and itscorresponding raster image process in accordance with prior art.

FIG. 1B is a flow diagram of a second conventional data output methodand its corresponding raster image process for an output device thatincludes a conventional printer controller in accordance with prior art.

FIGS. 2A and 2B are block diagrams illustrating components of anoperating environment that can implement the process and apparatus ofthe present invention.

FIG. 3A is a schematic block diagram illustrating hardware/softwarecomponents of an information apparatus implementation in accordance withthe present invention. The information apparatus includes an operatingsystem.

FIG. 3B is a second schematic block diagram illustratinghardware/software components of an information apparatus implementationin accordance with the present invention.

FIG. 4A is a block diagram of a conventional printing system or printerwith a conventional printer controller.

FIG. 4B is a block diagram of a second conventional output system oroutput device.

FIG. 5A is a schematic block diagram of a printing system or printerwith a conventional printer controller and an output controller inaccordance with present invention.

FIG. 5B is a schematic block diagram of a second output system or outputdevice that includes an output controller in accordance with presentinvention.

FIG. 6A is a schematic block diagram illustrating hardware/softwarecomponents of an output controller in accordance with present invention.The output controller includes an operating system.

FIG. 6B is a second schematic block diagram illustratinghardware/software components of an output controller in accordance withpresent invention. The output controller does not include an operatingsystem.

FIG. 6C is a third schematic block diagram illustratinghardware/software components of an output controller in accordance withpresent invention. The output controller combines the functionality of aprinter controller and an output controller of present invention.

FIGS. 7A-7F illustrate various configurations and implementations ofoutput controller with respect to an output device such as a printer.

FIG. 8A is a block diagram illustrating an exemplary implementation ofhardware/software components of wireless communication unit.

FIG. 8B is block diagram illustrating a second exemplary implementationof hardware/software components of wireless communication unit.

FIG. 9 is a flow diagram of a universal data output method and itscorresponding raster imaging process of the present invention.

FIG. 10 is a block diagram of a universal data output method of thepresent invention with respect to the components, system and apparatusdescribed with reference to FIG. 2.

FIG. 11 is a flow diagram illustrating one way of implementing adiscovery process optionally included in the output process of FIG. 10.

FIGS. 12A and 12B are flow diagrams of exemplary client applicationprocess included in the output process of FIG. 10.

FIGS. 13A and 13B are flow diagrams of exemplary output device or outputsystem process included in the output process of FIG. 10.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

Sets forth below are definitions of terms that are used in describingimplementations of the present invention. These definitions are providedto facilitate understanding and illustration of implementations of thepresent invention and should in no way be construed as limiting thescope of the invention to a particular example, class, or category.

Output Device Profile (or Object)

An output device profile (or object) includes software and data entity,which encapsulates within itself both data and attributes describing anoutput device and instructions for operating that data and attributes.An output device profile may reside in different hardware environmentsor platforms or applications, and may be transported in the form of afile, a message, a software object or component among other forms andtechniques. For simplicity of discussion, a profile or object may alsoinclude, for example, the concept of software components that may havevarying granularity and can consist of one class, a composite ofclasses, or an entire application.

The term profile or object used herein is not limited to software ordata as its media. Any entity containing information, descriptions,attributes, data, instructions etc. in any computer-readable form ormedium such as hardware, software, files based on or including voice,text, graphics, image, or video information, etc., are all valid formsof profile and object definition.

A profile or object may also contain in one of its fields or attributesa reference or pointer to another profile or object, or a reference orpointer to data and or content. A reference to a profile or object mayinclude one or more, or a combination of pointers, identifiers, names,paths, addresses or any descriptions relating to a location where anobject, profile, data, or content can be found.

An output device profile may contain one or more attributes that mayidentify and describe, for example, the capabilities and functionalitiesof a particular output device such as a printer. An output deviceprofile may be stored in the memory component of an output device, aninformation apparatus or in a network node. A network node includes anydevice, server or storage location that is connected to the network. Asdescribed below in greater detail, an information apparatus requestingoutput service may communicate with an output device. During such localservice negotiation, at least a partial output device profile may beuploaded to the information apparatus from the output device. Byobtaining the output device profile (or printer profile in the case of aprinter), the information apparatus may learn about the capability,compatibility, identification, and service provided by the outputdevice.

As an example, an output device profile may contain one or more of thefollowing fields and or attribute descriptions. Each of following fieldsmay be optional, and furthermore, each of the following fields orattributes may or may not exist in a particular implementation (e.g.,may be empty or NULL):

-   -   Identification of an output device (e.g., brand, model,        registration, IP address etc.)    -   Services and feature sets provided by an output device (e.g.,        color or grayscale output, laser or inkjet, duplex, output        quality, price per page, quality of service, etc.)    -   Type of input languages, formats, output data and/or input        requirements (e.g., PostScript, PCL, XML, RTL, etc.) supported        by an output device.    -   Device specific or dependent parameters and information (e.g.,        communication protocols, color space, color management methods        and rendering intents, resolution, halftoning methods, dpi        (dots-per-inch), bit depth, page size, printing speed, number of        independent colors channels or ink etc.)    -   Data and tables needed for image processing such as color table,        halftone table, scale factor, encoding/decoding parameters and        methods, compression and decompression parameters and method        etc.    -   Another profile which contain parameters and information about        the output device and its service (e.g. color profiles,        halftoning profiles, communication profiles, rasterization        profiles, quality of service etc.).    -   Payment information on a plurality of services provided by an        output device.    -   Information or security requirements and type of authentication        an output device supports.    -   Date and version of the output device profile, history of its        modification and updates.    -   Software components containing algorithms or instructions or        data, which may be uploaded to run in an information apparatus.        For example, a graphical user interface (GUI) software component        may be uploaded to an information apparatus. The software        component may be incorporated into or launched in the        information apparatus by a client application of present        invention to capture a user's preferences (e.g., print quality,        page layout, number of copies, number of cards per page, etc.).        In another example, software components may include methods,        instructions or executables for compression/decompression,        encoding/decoding, color matching or correction, segmentation,        scaling, halftoning, encryption/decryption among others.    -   Pointer or reference to one or more output device parameters,        including one or more of the above described output device        profile or object fields and or attribute descriptions. For        example, a more up-to-date or original version of output device        parameters may sometimes be stored in a network node (any        device, server or storage location that is connected to the        network), or within the information apparatus where it can be        obtained by the client application. An output device profile may        include pointer or pointers to these output device parameters.

Content (Or Data Content, Digital Content, Output Content)

Content (or data content, digital content, output content) is the dataintended for output, which may include texts, graphics, images, forms,videos, audio among other content types. Content may include the dataitself or a reference to that data. Content may be in any format,language, encoding or combination, and it can be in a format, languageor encoding that is partially or totally proprietary. A digital documentis an example of content that may include attributes and fields thatdescribe the digital document itself and or reference or references tothe digital document or documents. Examples of a digital document may beany one or combination of file types: HTML, VHTML, PostScript, PCL, XML,PDF, MS Word, PowerPoint, JPEG, MPEG, GIF, PNG, WML, VWML, CHTML, HDML,ASCII, 2-byte international coded characters, etc. Content may be usedinterchangeably with the term data content, output content or digitalcontent in the descriptions of present invention.

Intermediate Output Data

Output data (or print data in case of a printer) is the electronic datasent from an information apparatus to an output device. Output data isrelated to the content intended for output and may be encoded in avariety of formats and languages (e.g. postscript, PCL, XML), which mayinclude compressed or encrypted data. Some output device manufacturersmay also include in the output data (or print data) a combination ofproprietary or non-proprietary languages, formats, encoding,compression, encryption etc.

Intermediate output data is the output data of the present invention,and it includes the broader definition of an output file or datagenerated by an information apparatus, or a client application or devicedriver included in the information apparatus. An intermediate outputdata may contain text, vector graphics, images, video, audio, symbols,forms or combination and can be encoded with one or more of a pagedescription language, a markup language, a graphics format, an imagingformat, a metafile among others. An intermediate output data may alsocontain instructions (e.g. output preferences) and descriptions (e.g.data layout) among others. Part or all of an intermediate output datamay be compressed, encrypted or tagged.

In a preferred embodiment of this invention, intermediate output datacontains rasterized image data. For example, vector graphics and textinformation or objects that are not in image form included in contentcan be rasterized or conformed into image data in an informationapparatus and included in an intermediate output data. Device dependentimage processing operations of a RIP such as digital halftoning andcolor space conversions can be implemented at an output device or anoutput system.

The intermediate output data can be device dependent or deviceindependent. In one implementation, the rasterized output image isdevice dependent if the rasterization parameters used, such asresolution, scale factor, bit depth, output size and or color space aredevice dependent. In another implementation of this invention, therasterized image may be device independent if the rasterizationparameters used are device independent. Rasterization parameter canbecome device independent when those parameters include a set ofpredetermined or predefined rasterization parameters based on a standardor a specification. With predefined or device independent rasterizationparameters, a client application of present invention can rasterize atleast a portion of the content and generate a device independent imageor images included in the intermediate output data. By doing so, theintermediate output data may become device independent and therefore,become universally acceptable with output devices that have beenpre-configured to accept the intermediate output data.

One advantage of rasterizing or converting text and graphics informationinto image data at the information apparatus is that the output deviceor printer controller no longer needs to perform complex rasterizationoperation nor do they need to include multiple fonts. Therefore,employing the intermediate output data and the data output methoddescribed herein could potentially reduce the cost and complexity of anoutput controller, printer controller and or output device.

One form of image data encoding is known as mixed raster content, orMRC. Typically, an image stored in MRC includes more than one image orbitmap layers. In MRC, an image can be segmented in different layersbased on segmentation criteria such as background and foreground,luminance and chrominance among others. For example, an MRC may includethree layers with a background layer, a foreground layer and a toggle orselector layer. The three layers are coextensive and may includedifferent resolution, encoding and compression. The foreground andbackground layers may each contain additional layers, depending on themanner in which the respective part of the image is segmented based onthe segmentation criteria, component or channels of a color model, imageencoding representation (HLS, RGB, CMYK, YCC, LAB etc) among others. Thetoggle layer may designate, for each point, whether the foreground orbackground layer is effective. Each layer in a MRC can have differentbit depths, resolution, color space, which allow, for example, theforeground layer to be compressed differently from the background layer.The MRC form of image data has previously been used to minimize storagerequirements. Further, an MRC format has been proposed for use in colorimage fax transmission.

In one embodiment of present invention, the intermediate output dataincludes one or more rasterized output images that employ MRC format,encoding and or related compression method. In this implementation,different layers in the output image can have different resolutions andmay include different compression techniques. Different information suchas chrominance and luminance and or foreground and backgroundinformation in the original content (e.g. digital document) can besegmented and compressed with different compression or encodingtechniques. Segmented elements or object information in the originalcontent can also be stored in different image layers and with differentresolution. Therefore, with MRC, there is opportunity to reduce outputdata file size, retain greater image information, increase compressionratio, and improve image quality when compared to other conventionalimage encoding and compression techniques. Implementations ofrasterization, raster image processing and intermediate output data thatinclude MRC encoding in the present invention are described in moredetail below.

Rasterization

Rasterization is an operation by which graphics and text in a digitaldocument are converted to image data. For image data included in thedigital document, rasterization may include scaling and interpolation.The rasterization operation is characterized by rasterization parametersincluding, among others bit depth and resolution. A given rasterizationoperation may be characterized by several more rasterization parameters,including output size, color space, color channels etc. Values of one ormore of the rasterization parameters employed in a rasterizationoperation may be specified by default; values of one or more of therasterization parameters may be supplied to the information apparatus ascomponents of a rasterization vector. In a given application, therasterization vector may specify a value of only one rasterizationparameter, default values being employed for other rasterizationparameters used in the rasterization operation. In another applicationthe rasterization vector may specify values of more than one, but lessthan all, rasterization parameters, default values being employed for atleast one other rasterization parameter used in the rasterizationoperation. And in yet another application the rasterization vector mayspecify values of all the rasterization parameters used in therasterization operation.

FIGS. 2A and 2B are block diagrams illustrating components of anoperating environment that can implement the process and apparatus ofpresent invention. FIG. 2A shows an electronic system which includes aninformation apparatus 200 and an output device 220. The output device220 includes an output controller 230. FIG. 2B illustrates a secondimplementation of an electronic system that includes an informationapparatus 200 and an output system 250. The output system 250 includesan output device 220 and an output controller 230 which may beexternally connected to, or otherwise associated with, the output device220 in the output system 250.

Information apparatus 200 is a computing device with processingcapability. In one embodiment, information apparatus 200 may be a mobilecomputing device such as palmtop computer, handheld device, laptopcomputer, personal digital assistant (PDA), smart phone, screen phone,e-book, Internet pad, communication pad, Internet appliance, pager,digital camera, etc. It is possible that information apparatus 200 mayalso include a static computing device such as a desktop computer,workstation, server, etc.

FIGS. 3A and 3B are block diagrams illustrating examples ofhardware/software components included in an information apparatus 200 ofpresent invention.

Information apparatus 200 may contain components such as a processingunit 380, a memory unit 370, an optional storage unit 360 and aninput/output control unit (e.g. communication manager 330). Informationapparatus 200 may include an interface (not shown) for interaction withusers. The interface may be implemented with software or hardware or acombination. Examples of such interfaces include, without limitation,one or more of a mouse, a keyboard, a touch-sensitive ornon-touch-sensitive screen, push buttons, soft keys, a stylus, aspeaker, a microphone, etc.

Information apparatus 200 typically contains one or more networkcommunication unit 350 that interfaces with other electronic devicessuch as network node (not shown), output device 220, and output system230. The network communication unit may be implemented with hardware(e.g., silicon chipsets, antenna), software (e.g., protocol stacks,applications) or a combination.

In one embodiment of the present invention, communication interface 240between information apparatus 200 and output device 220 or output system250 is a wireless communication interface such as a short-range radiointerface including those implemented according to the Bluetooth or IEEE802.11 standard. The communication interface may also be realized byother standards and/or means of wireless communication that may includeradio, infrared, cellular, ultrasonic, hydrophonic among others foraccessing one or more network node and/or devices. Wired lineconnections such as serial or parallel interface, USB interface and firewire (IEEE 1394) interface, among others, may also be included.Connection to a local network such as an Ethernet or a token Ringnetwork, among others, may also be implemented in the present inventionfor local communication between information apparatus 200 and outputdevice 220. Examples of hardware/software components of communicationunits 350 that may be used to implement wireless interface between theinformation apparatus 200 and the output device 220 are described inmore detail with reference to FIGS. 8A and 8B below.

For simplicity, FIG. 3 illustrates one implementation where aninformation apparatus 200 includes one communication unit 350. However,it should be noted that an information apparatus 200 may contain morethan one communication unit 350 in order to support differentinterfaces, protocols, and/or communication standards with differentdevices and/or network nodes. For example, information apparatus 200 maycommunicate with one output device 220 through a Bluetooth standardinterface or through an IEEE 802.11 standard interface whilecommunicating with another output device 220 through a parallel cableinterface. The information apparatus 200 may also be coupled to a wiredor wireless network (e.g. the Internet or corporate network) to send,receive and/or download information.

Information apparatus 200 may be a dedicated device (e.g., emailterminal, web terminal, digital camera, e-book, web pads, Internetappliances etc.) with functionalities that are pre-configured bymanufacturers. Alternatively, information apparatus 200 may allow usersto install additional hardware components and or application software205 to expand its functionality.

Information apparatus 200 may contain a plurality of applications 205 toimplement its feature sets and functionalities. As an example, adocument browsing or editing application may be implemented to help userview and perhaps edit, partially or entirely, digital documents writtenin certain format or language (e.g., page description language, markuplanguage, etc.). Digital documents may be stored locally in theinformation apparatus 200 or in a network node (e.g., in contentserver). An example of a document browsing application is an Internetbrowser such as Internet Explorer, Netscape Navigator, or a WAP browser.Such browsers may retrieve and display content (e.g. digital content)written in mark-up languages such as HTML, WML, XML, CHTML, HDML, amongothers. Other examples of software applications in the informationapparatus 200 may include a document editing software such as MicrosoftWord™ which also allows users to view and or edit digital documents thathave various file extensions (e.g., doc, rtf, html, XML etc.) whetherstored locally in the information apparatus 200 or in a network node.Still, other example of software applications 205 may include imageacquisition and editing software.

As illustrated previously with reference to FIG. 1, there are manydifficulties in providing output capability to an information apparatus200 that has limited memory and processing capability. To address thesesdifficulties, information apparatus 200 includes a client application210 that helps provide the universal data output capability of thepresent invention. Client application 210 may include software and datathat can be executed by the processing unit 380 of information apparatus200. Client application 210 may be implemented as a stand-alone softwareapplication or as a part of or feature of another software application,or in the form of a device driver, which may be invoked, shared and usedby other application software 205 in the information apparatus 200.Client application 210 may also include components to invoke otherapplications 205 (e.g., a document browsing application, editingapplication, data and/or image acquisition application, a communicationmanager, a output manager etc.) to provide certain feature sets, asdescribed below. FIG. 3 illustrates a configuration where the clientapplication 210 is a separate application from the other application 205such as the case when the client application is a device driver;however, it should be noted that the client application 210 can becombined or being part of the other application not shown in FIG. 3.Client application 210 may be variously implemented in an informationapparatus 200 and may run on different operating systems or platforms.The client application 210 may also run in an environment with nooperating system. For example, FIG. 3A illustrates an implementationwhere the information apparatus 200A includes an operating system 340A;while FIG. 3B illustrates an implementation where the informationapparatus 200B does not include an operating system.

Client application 210 includes a rasterization component 310 to conformcontent into one or more raster output images according to one or morerasterization parameters; an intermediate output data generatorcomponent 320 that generates and/or encodes intermediate output datathat includes the one or more output images; and a communicationsmanager 330 that manages the communication and interaction with anoutput device 220 or system 250 or output controller 230. Communicationsmanager can be implemented as part of the client application 210 (shownin FIG. 3) or as a separate application (not shown). Components in aclient application can be implemented in software, hardware orcombination. As an example, client application 210 may include orutilize one or more of the following:

-   -   Components or operations to obtain content (e.g. digital        document) for output. The client application 210 may obtain a        digital document from other applications 205 (e.g. document        browsing application, content creation and editing application,        etc.), or the client application 210 may provide its own        capability for user to browse, edit and or select a digital        document.    -   Components or operations to rasterize content that includes        text, graphics and images among others objects or elements into        one or more raster images according to a set of rasterization        parameters such as scale factor, output size, bit depth, color        space and resolution. The rasterization parameters may be        obtained in various ways, for example, from an output device        profile uploaded from an output device 220, or stored locally in        information apparatus 200, or manually inputted by a user.        Alternatively, rasterization parameters may be based on a        predefined standard or specification stored in the information        apparatus 200 as a set of defaults, or hard-coded in the client        application 210, or calculated by the client application 210        after communicating with an output device 220, output controller        230, and/or a user.    -   Components or operations to generate intermediate output data        that includes at least one rasterized output image corresponding        to the content (e.g. digital document). This process may further        include one or combination of compression, encoding, encryption        and color correction among others. The intermediate output data        may include, for example, images, instructions, documents and or        format descriptions, color profiles among others.    -   Components or operations to transmit the intermediate output        data to an output device 220 or system 250 through wired or        wireless communication link 240.

The client application 210 may also optionally include or utilize one ormore of the following components or operations:

-   -   Components or operations to communicate with one or more output        devices 220 to upload an output device profile.    -   Components or operations to communicate directly or indirectly        (such as through an operating system or component or object        model, messages, file transfer etc.) with other applications 205        residing in the same information apparatus 200 to obtain        objects, data, and or content needed, or related to the        pervasive output process of present invention (e.g. obtain a        digital document for printing).    -   Components or operations to manage and utilize directly or        indirectly functionalities provided by hardware components (e.g.        communication unit 350) residing in its host information        apparatus 200.    -   Components or operations to provide a graphical user interface        (GUI) in host information apparatus to interact with user.    -   Components or operations to obtain user preferences. For        example, a user may directly input his or her preferences        through a GUI. A set of default values may also be employed.        Default values may be pre-set or may be obtained by information        apparatus 200 as result of communicating and negotiating with an        output device 220 or output controller 230.

The above functionalities and process of client application 210 ofpresent invention are described in further detail in the clientapplication process with reference to FIG. 12.

Output device 220 is an electronic system capable of outputting digitalcontent regardless of whether the output medium is substrate (e.g.,paper), display, projection, or sound. A typical example of outputdevice 220 is a printer, which outputs digital documents containingtext, graphics, image or any combination onto a substrate. Output device220 may also be a display device capable of displaying still images orvideo, such as, without limitation, televisions, monitors, andprojectors. Output device 220 can also be a device capable of outputtingsound. Any device capable of playing or reading digital content in audio(e.g., music) or data (e.g., text or document) formats is also apossible output device 220.

A printer is frequently referred to herein as an example of an outputdevice to simplify discussion or as the primary output device 220 in aparticular implementation. However, it should be recognized that presentinvention applies also to other output devices 220 such as fax machines,digital copiers, display screens, monitors, televisions, projectors,voice output devices, among others.

Rendering content with an output device 220 refers to outputting thecontent on a specific output medium (e.g., papers, display screens etc).For example, rendering content with a printer generates an image on asubstrate; rendering content with a display device generates an image ona screen; and rendering content with an audio output device generatessound.

A conventional printing system in general includes a raster imageprocessor and a printer engine. A printer engine includes memory buffer,marking engine among other components. The raster image processorconverts content into an image form suitable for printing; the memorybuffer holds the rasterized image ready for printing; and the markingengine transfers colorant to substrate (e.g., paper).

The raster image processor may be located within an output device (e.g.included in a printer controller 410) or externally implemented (in aninformation apparatus 200, external controller, servers etc). Rasterimage processor can be implemented as hardware, software, or acombination (not shown). As an example, raster image processor may beimplemented in a software application or device driver in theinformation apparatus 200. Examples of raster image processingoperations include image and graphics interpretation, rasterization,scaling, segmentation, color space transformation, image enhancement,color correction, halftoning, compression etc.

FIG. 4A illustrates a block diagram of one conventional printing systemor printer 400A that includes a printer controller 410 and a printerengine 420A. The printer controller 410 includes an interpreter 402 anda raster image processor 406, and the printer engine 420 includes memorybuffer 424A and a marking engine 426A.

Marking engine may use any of a variety of different technologies totransfer a rasterized image to paper or other media or, in other words,to transfer colorant to a substrate. The different marking or printingtechnologies that may be used include both impact and non-impactprinting. Examples of impact printing may include dot matrix, teletype,daisywheel, etc. Non-impact printing technologies may include inkjet,laser, electrostatic, thermal, dye sublimation, etc.

The marking engine 426 and memory buffer 424 of a printer form itsprinter engine 420, which may also include additional circuitry andcomponents, such as firmware, software or chips or chipsets for decodingand signal conversion, etc. Input to a printer engine 420 is usually afinal rasterized printer-engine print data generated by a raster imageprocessor 406. Such input is usually device dependent and printer orprinter engine specific. The printer engine 420 may take this devicedependent input and generate or render output pages (e.g. with ink on asubstrate).

When a raster image processor is located inside an output device 220, itis usually included in a printer controller 410 (as shown in FIG. 4A). Aprinter controller 410 may interpret, rasterize, and convert input printdata in the form of a page description language (e.g., PostScript, PCL),markup language (e.g., XML, HTML) or other special document format orlanguage (e.g. PDF, EMF) into printer-engine print data which is a finalformat, language or instruction that printer engine 420A can understand.

Print data sent to a printer with printer controller 410 is usually in aform (e.g. postscript) that requires further interpretation, processingor conversion. A printer controller 410 receives the print data,interprets, process, and converts the print data into a form that can beunderstood by the printer engine 420A. Regardless of the type of printdata, conventionally, a user may need a device-specific driver in his orher information apparatus 200 in order to output the proper language,format, or file that can be accepted by a specific printer or outputdevice 220.

FIG. 4B illustrates another conventional output device 400B. Outputdevice 400B may be a printing device, a display device, a projectiondevice, or a sound device. In the case that the output device is aprinting device or a printer, the printer with reference to FIG. 4B doesnot include a printer controller 410. As an example, printer 400B may bea low-cost printer such as a desktop inkjet printer. RIP operations inthis example may be implemented in a software application or in a devicedriver included in an information apparatus 200. The informationapparatus 200 generates device dependent output data (or print data incase of a printer) by rasterizing and converting a digital document intooutput data (e.g. into a compressed CMKY data with one or more bits perpixel) that can be understood by an output engine (or printer engine incase of a printer) 420B.

Regardless of type or sophistication level, different output device 220conventionally needs different printer drivers or output managementapplications in an information apparatus 200 to provide outputcapability. Some mobile devices with limited memory and processing powermay have difficulty storing multiple device drivers or performcomputational intensive RIP operations. It may also be infeasible toinstall a new device dependent or specific printer driver each timethere is a need to print to a new printer. To overcome thesedifficulties, present invention provides several improvements to outputdevice 220 or output system 250 as described in detail next.

In present invention, output device 220 may include an output controller230 to help managing communication and negotiation processes with aninformation apparatus 200 and to process output data. Output controller230 may include dedicated hardware or software or combination of bothfor at least one output device 220. Output controller 230 may beinternally installed, or externally connected to one or more outputdevices 220. The output controller 230 is sometimes referred to as aprint server or output server.

FIGS. 5A and 5B illustrate two exemplary internal implementations of theoutput controller 230 of present invention. FIG. 5A illustrates theimplementation of an output controller 230 inside a conventional printerwith reference to FIG. 4A, which includes a conventional printercontroller 410(5A). The output controller 230(5A) includes aninterpreter 510A component for decoding the intermediate output data ofpresent invention; and a converter component 530A for converting one ormore decoded output images into a printer-controller print data that issuitable for input to the printer controller 410(5A). An optional imageprocessing component 520A may be included in the output controller230(5A).

FIG. 5B illustrates the implementation of an output controller 230included internally in a conventional output device 220 with referenceto FIG. 4B, which does not include a printer controller. The outputcontroller 230(5B) includes an interpreter 510B component for decodingthe intermediate output data of present invention; an image processor520B component for performing one or more image processing operationssuch as color space conversion, color matching and digital halftoning;and an optional encoder 530B component to conform the processed outputimages into an output-engine output data that is suitable for input tothe output engine 420B if the result of the image processing is notalready in required form suitable for the output engine 420B.

In one implementation, output device 220 may include a communicationunit 550 or adapter to interface with information apparatus 200. Outputdevice 220 may sometimes include more than one communication unit 550 inorder to support different interfaces, protocols, or communicationstandards with different devices. For example, output device 220 maycommunicate with a first information apparatus 200 through a Bluetoothinterface while communicating with a second information apparatus 200through a parallel interface. Examples of hardware components of awireless communication unit are described in greater detail below withreference to FIGS. 8A and 8B.

In one embodiment, output controller 230 does not include acommunication unit, but rather utilizes or manages a communication unitresiding in the associated output device 220 such as the illustration inFIG. 5. In another embodiment, output controller 230 may include orprovide a communication unit to output device 220 as shown in FIG. 6.For example, an output controller 230 with a wireless communication unitmay be installed internally or connected externally to a legacy printerto provide it with wireless communication capability that was previouslylacking.

FIG. 6 includes three functional block diagrams illustrating thehardware/software components of output controller 230 in three differentimplementations. Each components of an output controller 230 may includesoftware, hardware, or combination. For example, an output controller230 may include components using one or more or combinations of anapplication-specific integrated circuit (ASIC), a digital signalprocessor (DSP), a field programmable gate array (FPGA), firmware,system on a chip, and various communication chip sets. Output controller230 may also contain embedded processors 670 A with software componentsor embedded application software to implement its feature sets andfunctionalities.

Output controller 230 may contain an embedded operating system 680. Withan operating system, some or all functionalities and feature sets of theoutput controller 230 may be provided by application software managed bythe operating system. Additional application software may be installedor upgraded to newer versions in order to, for example, provideadditional functionalities or bug fixes. FIG. 6A and FIG. 6C illustratesexamples of implementation with an operating system 680 while FIG. 6Billustrates an example without the operating system 680 or the optionalembedded processor 670.

Output controller 230 typically includes a memory unit 640, or may sharea memory unit with, for example, printer controller 410. The memory unitand storage unit, such as ROM, RAM, flash memory and disk drive amongothers, may provide persistent or volatile storage. The memory unit orstorage unit may store output device profiles, objects, codes,instructions or data (collectively referred to as software components)that implement the functionalities of the output controller 230. Part ofthe software components (e.g., output device profile) may be uploaded toinformation apparatus 200 during or before a data output operation.

An output controller 230 may include a processor component 670A and670C, a memory component 650, an optional storage component 640, and anoptional operating system component 680. FIG. 6 shows one architectureor implementation where the memory 650, storage 640, processor 670, andoperating system 680 components, if exist, can be share or accessed byother operational components in the output controller 230 such as theinterpreter 610 and image processor 650. FIG. 6 shows two communicationunits 660A and 660B included in the output controller 230; however, theoutput controller 230 of present invention may include any number ofcommunication units 660. It is also possible that the output controllerdoes not contain any communication unit but rather utilizes thecommunication unit of an output device.

The output controller 230 may be connected externally to an outputdevice 220 or integrated internally into the output device 220. FIGS. 5Aand 5B illustrate implementations of output controller 230 inside anoutput device 220. The output controller 230, however, may also beimplemented as an external box or station that is wired or wirelesslyconnected to an output device 220. An output controller 230 implementedas an external box or station to an output device 220 may contain itsown user interface. One example of such an implementation is a printserver connected to an output device 220 in an output system 250.Another configuration and implementation is to integrate or combine thefunctionalities of an output controller 230 with an existing printercontroller 410 (referred to as “combined controller”) if the outputdevice 220 is a printer as shown with reference to FIG. 7C or 7F. Acombined controller can also be internally integrated or externallyconnected to output device 220, and include functionalities of bothprinter controller 410 (e.g., input interpretation and or raster imageprocessing) and output controller 230 of present invention. Oneadvantage of this configuration is that the functionalities orcomponents of output controller 230 and printer controller 410 may sharethe same resources, such as processing unit, memory unit, etc. FIG. 6Cillustrates an example of a combined controller implementation or outputcontroller 230 where the printer controller 410C, interpreter 610C andconverter 630C shares the use of the processor 670C, memory 650C andstorage 640C, managed by an operating system 680C. Various exemplaryimplementations and configurations of an output controller 230 withrespect to an output device 220 or output system 250 are illustrated infurther detail with reference to FIG. 7.

Other possible implementations of output controller 230 may include, forexample, a conventional personal computer (PC), a workstation, and anoutput server or print server. In these cases, the functionalities ofoutput controller 230 may be implemented using application softwareinstalled in a computer (e.g., PC, server, or workstation), with thecomputer connected with a wired or wireless connection to an outputdevice 220. Using a PC, server, workstation, or other computer toimplement the feature sets of output controller 230 with applicationsoftware is just another possible embodiment of the output controller230 and in no way departs from the spirit, scope and process of thepresent invention.

The difference between output controller 230 and printer controller 410should be noted. Printer controller 410 and output controller 230 areboth controllers and are both dedicated hardware and or software for atleast one output device 220. Output controller 230 refers to acontroller with feature sets, capabilities, and functionalities of thepresent invention. A printer controller 410 may contain functions suchas interpreting an input page description language, raster imageprocessing, and queuing, among others. An output controller 230 mayinclude part or all of the features of a printer controller 410 inaddition to the feature sets, functionalities, capabilities, andprocesses of present invention.

Functionalities and components of output controller 230 for the purposeof providing universal data output may include or utilize:

-   -   Components and operations to receive output data from a        plurality of information apparatus 200; the output data may        include an intermediate output data containing at least one        rasterized image related to the data content intended for        output.    -   Components and operations to interpret and/or decode the        intermediate output data.    -   Components and operations to process the intermediate output        data. Such components and operations may include image        processing functions such as scaling, segmentation, color        correction, color management, GCR, image enhancement,        decompression, decryption, and or halftoning among others.    -   Components and operations to generate an output-engine output        data, the output-engine output data being in an output data        format acceptable for input to an output engine.    -   Components and operations to send the output-engine output data        to the output engine.

When associated with an output device 220 that includes a printercontroller 410, the output controller of present invention may furtherinclude or utilize:

-   -   Components and operations to convert the intermediate output        data into a printer-controller print data (e.g. a PDL such as        PostScript and PCL), the printer-controller print data being in        a format acceptable to a printer controller.    -   Components and operations to send printer-controller print data        to one or more printer controllers.

In addition to the above components and functionalities, outputcontroller 230 may further include one or more of the following:

-   -   Components and operations to communicate with one or more        information apparatus 200 through a wired or wireless interface.    -   Components and operations to communicate and or manage a        communication unit included in the output controller 230 or        output device 220.    -   Components and operations to store at least part of an output        device profile (a printer profile in case of a printer) in a        memory component.    -   Components and operations to respond to service request from an        information apparatus 200 by transmitting at least part of an        output device profile to the information apparatus requesting        service. The output controller 230 may transmit the output        device profiles or object in one or multiple sessions.    -   Components and operations to broadcast or advertise the services        provided by a host output device 220 to one or more information        apparatus 200 that may request such services.    -   Components and operations to implement payment processing and        management functions by, for example, calculating and processing        payments according to the services requested or rendered to a        client (information apparatus 200).    -   Components and operations to provide a user interface such as        display screen, touch button, soft key, etc.    -   Components and operations to implement job management functions        such as queuing and spooling among others.    -   Components and operations to implement security or        authentication procedures. For example, the output controller        230 may store in its memory component (or shared memory        component) an access control list, which specifies what device        or user may obtain service from its host (or connected) output        device 220. Therefore, an authorized information apparatus 200        may gain access after confirming with the control list.

When output controller 230 is implemented as firmware, or an embeddedapplication, the configuration and management of the functionalities ofoutput controller 230 may be optionally accomplished by, for example,using controller management software in a host computer. A host computermay be a desktop personal computer (PC), workstation, or server. Thehost computer may be connected locally or through a network to theoutput device 220 or the controller 230. Communication between the hostcomputer and the output controller 230 can be accomplished through wiredor wireless communication. The management application software in thehost computer can manage the settings, configurations, and feature setsof the output controller 230. Furthermore, host computer's configurationapplication may download and or install application software, softwarecomponents and or data to the output controller 230 for the purpose ofupgrading, updating, and or modifying the features and capabilities ofthe output controller 230.

Output device 220 in one implementation includes or is connected tooutput controller 230 described above. Therefore, functionalities andfeature sets provided by output controller 230 are automaticallyincluded in the functionalities of output device 220. The output device220 may, however, implement or include other controllers and/orapplications that provide at least partially the features andfunctionalities of the output controller 230.

Therefore, the output device 220 may include some or all of thefollowing functionalities:

-   -   Components and operations to receive multiple service requests        or queries (e.g., a service request, a data query, an object or        component query etc.) from a plurality of information apparatus        200 and properly respond to them by returning components, which        may contain data, software, instructions and/or objects.    -   Components and operations to receive output data from a        plurality of information apparatus 200; the output data may        include an intermediate output data containing one or more        rasterized image related to the content intended for output.    -   Components and operations to interpret and/or decoding the        intermediate output data.    -   Components and operations to process and/or convert the        intermediate output data into a form (e.g. output-engine print        data) suitable for rendering at an output engine associated with        the output device.    -   Components and operations to render a representation or an image        related to the content onto an output medium (e.g. substrate or        a display screen).

An output device 220 may further comprise optionally one or more of thefollowing functionalities:

-   -   Components and operations for establishing and managing a        communication link with an information apparatus 200 requesting        service; the communication link may include wired or wireless        communication.    -   Components and operations for storing at least part of an output        device profile (e.g. printer profile) in a memory component.    -   Components and operations to provide at least part of an output        device profile (e.g., printer profile in case of a printer) to        one or more information apparatus 200 requesting service. The        output device 220 may transmit the output device profile in one        or multiple sessions.    -   Components and operations to advertise or broadcast services        provided or available to one or more information apparatus 200.    -   Components and operations to implement payment processing and        management functions by, for example, calculating and processing        payments according to the services requested by or rendered to a        client (information apparatus 200).    -   Components and operations to implement job management        functionalities such as queuing and spooling among others.    -   Components and operations to provide a user interface such as        display screen touch button, soft key, power switch, etc.    -   Components and operations to implement security or        authentication procedures. For example, the output device 220        may store in its memory component (or a shared memory component)        an access control list, which specifies what device or user may        obtain service from it. Therefore, an authorized information        apparatus 200 may gain access after confirming with the control        list.

FIGS. 7A-7F illustrate various alternative configurations andimplementations of output controller 230 with respect to an outputdevice 230. Printer is sometimes used as an exemplary output device 230to demonstrate the various configurations. It should be understood,however, the output device 230 of present invention is not limited toprinters.

As described with reference to FIG. 4, a printer may or may not containa printer controller 410. Printer 400A that includes a printercontroller 410 typically has higher speed and is more expensive thanprinter 400B which does not include a printer controller 410.

FIG. 7A shows that output controller 230 may be cascaded externally toone or more printers (only one shown). Information apparatus 200communicates with output controller 230A, which then communicates withoutput device 220 such as a printer 220A. The communication link betweenthe output controller 230A and the printer 220A may be a wired link or awireless link, as described above. FIGS. 6A and 6B illustrates twoexamples of functional component design of the output controller thatcan implement the configuration illustrated in FIG. 7A. The Imageprocessor 620 in this implementation is optional.

FIG. 7B shows another implementation in which output controller 230B isinstalled as one or more circuit boards or cards internally insideprinter 220B. The output controller 230B may co-exist with printercontroller 410 and other components of the printer 220B. One example ofthis implementation is to connect output controller 230B sequentiallywith the printer controller 310. FIG. 5A shows as an example of animplementation.

FIG. 7C shows another implementation in which the functionalities ofoutput controller 230 and printer controller 410 are combined into asingle controller (referred to as “combined controller”) 230C. In thisimplementation, it is possible to reduce the cost of material whencompared to implementing two separate controllers as shown in FIG. 7B.As an example, the combined controller 230C may share the sameprocessors, memories, and storages to run the applications andfunctionalities of the two types of controllers and therefore, may havelower component costs when compared to providing two separatecontrollers. FIG. 6C illustrates an example of a combined controllerfunctional component implementation.

Some printers do not include a raster image processor or printercontroller 410, as illustrated in FIG. 4B. An example of this type ofprinter is a lower cost desktop inkjet printer. Input to an inkjetprinter may consist of a compressed CMYK data (proprietary or published)with one or more bits per pixel input. To output to a printer that doesnot include a printer controller, a device specific software applicationor a printer driver is typically required in an information apparatus200 to perform raster image processing operations. Accordingly, outputcontroller 230 can be implemented into a variety of output devices 220and/or output systems 250 including printers that do not have printercontrollers for performing raster image processing operations.

FIG. 7D and FIG. 7E illustrate two implementations of output controller230 in an output device 220 or system 250. The output device 230 orsystem 250 may include a display device, a projection device, an audiooutput device or a printing device. In the case when the output device220D or 220E is a printer, it does not include a printer controller.FIG. 7D illustrates an implementation of an output controller 230Dinstalled as an external component or “box” to output device 220D. Forexample, the output controller 230 may be implemented as an applicationin a print server or as a standalone box or station. In thisconfiguration, some or all of raster image processing operations may beimplemented in the output controller 230D. Output controller 230Dreceives intermediate output data from an information apparatus 200 andgenerates output-engine output data that is acceptable to the outputengine included in the output device 220D. The output controller 230Dmay send the output data to the output device 220D through a wired orwireless communication link or connection. FIGS. 6A and 6B illustratestwo example of functional component design of the output controller thatcan implement the configurations for both FIGS. 7D and 7E.

FIG. 7E shows a fifth implementation of output controller 230E in whichthe output controller 230E is incorporated within output device 220E asone or more circuit boards or cards and may contain software andapplications running on an embedded processor. As with output device220D (FIG. 7D), output device 220E does not include a printer controller410. Accordingly, the output controller 230E implements thefunctionalities and capabilities of present invention that may includepart of or complete raster imaging processing operation.

FIG. 7F shows a sixth implementation, an external combined controller230F that integrates the functionalities of a printer controller 310 andan output controller into a single external combined controllercomponent or “box” 230F. The two controller functions may share a commonprocessor as well as a common memory space to run applications of thetwo types of controllers. Under this configuration, either informationapparatus 200 or the combined controller 230F could perform or share atleast part of raster image processing functionality. FIG. 6C shows anexample of functional components of a combined controller 230F.

Another implementation of the combined controller 230F shown in FIG. 7Fis to use an external computing device (PC, workstation, or server)running one or more applications that include the functionality ofoutput controller 230 and printer controller 410.

The above are examples of different implementations and configurationsof output controller 230. Other implementations are also possible. Forexample, partial functionalities of output controller 230 may beimplemented in an external box or station while the remainingfunctionalities may reside inside an output device 220 as a separateboard or integrated with a printer controller 410. As another example,the functionalities of output controller 230 may be implemented into aplurality of external boxes or stations connected to the same outputdevice 220. As a further example, the same output controller 230 may beconnected to service a plurality of output devices 220

FIGS. 8A and 8B are block diagrams illustrating two possibleconfigurations of hardware/software components of wireless communicationunits. These wireless communication units can be implemented andincluded in information apparatus 200, in output controller 230 and inoutput device 220. Referring to FIG. 8A, a radio adapter 800 may beimplemented to enable data/voice transmission among devices (e.g.,information apparatus 200 and output device 220) through radio links. AnRF transceiver 814 coupled with antenna 816 is used to receive andtransmit radio frequency signals. The RF transceiver 814 also convertsradio signals into and from electronic signals. The RF transceiver 814is connected to an RF link controller 810 by an interface 812. Theinterface 812 may perform functions such as analog-to-digitalconversion, digital-to-analog conversion, modulation, demodulation,compression, decompression, encoding, decoding, and other data or formatconversion functions.

RF link controller 810 implements real-time lower layer (e.g., physicallayer) protocol processing that enables the hosts (e.g., informationapparatus 200, output controller 230, output device 220, etc.) tocommunicate over a radio link. Functions performed by the linkcontroller 810 may include, without limitation, errordetection/correction, power control, data packet processing, dataencryption/decryption and other data processing functions.

A variety of radio links may be utilized. A group of competingtechnologies operating in the 2.4 GHz unlicensed frequency band is ofparticular interest. This group currently includes Bluetooth, Home radiofrequency (Home RF) and implementations based on IEEE 802.11 standard.Each of these technologies has a different set of protocols and they allprovide solutions for wireless local area networks (LANs). Interferenceamong these technologies could limit deployment of these protocolssimultaneously. It is anticipated that new local area wirelesstechnologies may emerge or that the existing ones may converge.Nevertheless, all these existing and future wireless technologies may beimplemented in the present invention without limitation, and therefore,in no way depart from the scope of present invention.

Among the currently available wireless technologies, Bluetooth may beadvantageous because it requires relatively lower power consumption andBluetooth-enabled devices operate in piconets, in which several devicesare connected in a point-to-multipoint system. Referring to FIG. 8B, oneor more infrared (IR) adapters 820 may be implemented to enable datatransmission among devices through infrared transmission. The IRadapters 820 may be conveniently implemented in accordance with theInfrared Data Association (IrDA) standards and specifications. Ingeneral, the IrDA standard is used to provide wireless connectivitytechnologies for devices that would normally use cables for connection.The IrDA standard is a point-to-point (vs. point-to-multipoint as inBluetooth), narrow angle, ad-hoc data transmission standard.

Configuration of infrared adapters 820 may vary depending on theintended rate of data transfer. FIG. 8B illustrates one embodiment ofinfrared adapter 820. Transceiver 826 receives/emits IR signals andconverts IR signals to/from electrical signals. A UART (universalasynchronous receiver/transmitter) 822 performs the function ofserialization/deserialization, converting serial data stream to/fromdata bytes. The UART 822 is connected to the IR transceiver 826 byencoder/decoder (ENDEC) 824. This configuration is generally suitablefor transferring data at relatively low rate. Other components (e.g.,packet framer, phase-locked loop) may be needed for higher data transferrates.

FIGS. 8A and 8B illustrate exemplary hardware configurations of wirelesscommunication units. Such hardware components may be included in devices(e.g., information apparatus 200, output controller 230, output device220, etc.) to support various wireless communications standards. Wiredlinks, however, such as parallel interface, USB, Firewire interface,Ethernet and token ring networks may also be implemented in the presentinvention by using appropriate adapters and configurations.

FIG. 9 is a logic flow diagram of an exemplary raster imaging process(RIP) 902 that can implement the universal output method of presentinvention. Content (e.g. digital document) 900 may be obtained and/orgenerated by an application running in an information apparatus 200. Forexample, a document browsing application may allow a user to downloadand or open digital document 900 stored locally or in a network node. Asanother example, a document creating or editing application may allow auser to create or edit digital documents in his/her informationapparatus 200.

A client application 210 in the information apparatus may be in the formof a device driver, invoked by other applications residing in theinformation apparatus 200 to provide output service. Alternatively, theclient application 210 of present invention may be an application thatincludes data output and management component, in addition of otherfunctionalities such as content acquisitions, viewing, browsing, and orediting etc. For example, a client application 210 in an informationapparatus 200 may itself include components and functions for a user todownload, view and or edit digital document 900 in addition of theoutput management function described herein.

Raster image process method 902 allows an information apparatus 200 suchas a mobile device to pervasively and conveniently output content (e.g.a digital document) to an output device 220 or system 250 that includesan output controller 230. A client application 210 in an informationapparatus 200 may perform part of raster image processing operations(e.g. rasterization operation). Other operations of raster imageprocessing such as halftoning can be completed by the output device 220or by the output controller 230. In conventional data output methods,raster image processing is either implemented entirely in an informationapparatus (e.g. a printer that does not include a printer controllerwith reference to FIG. 1A) or in an output device (e.g. a printer thatincludes a printer controller with reference to FIG. 1B). Presentinvention provides a more balanced approach where raster image processoperations are shared between an information apparatus 200 and an outputdevice 220 or system 250. For example, content 600 may be processed(e.g. raster image processed) by different components or parts of anoverall output system from a client application 210 to an outputcontroller 230 before being sent to an output engine or a printer enginefor final output in step 960. Because the raster image processingoperations are not completely implemented in the information apparatus200, there is less processing demand on the information apparatus 200.Therefore, present RIP process may enable additional mobile devices withless memory and processing capability to have data output capability.

In step 910, rasterization operation, a content (e.g. digital document),which may include text, graphics, and image objects, is conformed orrasterized to image form according to one or more rasterizationparameters such as output size, bit depth, color space, resolution,number of color channels etc. During the rasterization operation, textand vector graphics information in the content are rasterized orconverted into image or bitmap information according to a given set ofrasterization parameters. Image information in the content or digitaldocument may be scaled and or interpolated to fit a particular outputsize, resolution and bit depth etc. The rasterization parameters are ingeneral device dependent, and therefore may vary according to differentrequirements and attributes of an output device 220 and its outputengine. There are many ways to obtain device dependent rasterizationparameters, as described in more detail below with reference to FIG.12A. Device dependent rasterization parameters, in one example, may beobtained from an output device profile stored in an informationapparatus 200, an output device 220 or an output controller 230.

In an alternative implementation, rasterization parameters may bepredetermined by a standard or specification. In this implementation, instep 910 the content 900 is rasterized to fit or match this predefinedor standard rasterization parameters. Therefore, the rasterized outputimage becomes device independent. One advantage of being deviceindependent is that the rasterized output image is acceptable withcontrollers, devices and/or output devices implemented or created withthe knowledge of such standard or specification. A rasterized image withpredefined or standardized attributes is usually more portable. Forexample, both the client application 210 and output device 220 or itsoutput controller 230 may be preprogrammed to receive, interpret, and oroutput raster images based on a predefined standard and/orspecification.

Occasionally, a predefined standard or specification for rasterizationparameters may require change or update. One possible implementation forproviding an easy update or upgrade is to store information and relatedrasterization parameters in a file or a profile instead of hard codingthese parameters into programs, components or applications. Clientapplication 210, output controller 230, and/or the output device 220 canread a file or a profile to obtain information related to rasterizationparameters. To upgrade or update the standard specification or defaultsrequires only replacing or editing the file or the profile instead ofreplacing a software application or component such as the clientapplication 210.

In step 920 the rasterized content in image form is encoded into anintermediate output data. The intermediate output data, which describesthe output content, may include image information, instructions,descriptions, and data (e.g. color profile). The rasterized output imagemay require further processing including one or more of compression,encoding, encryption, smoothing, image enhancement, segmentation, colorcorrection among others before being stored into the intermediate outputdata. The output image in the intermediate output data may be encoded inany image format and with any compression technique such as JPEG, BMP,TIFF, JBIG etc. In one preferred embodiment, a mixed raster content(MRC) format and its related encoding and/or compression methods areused to generate the output image. The advantages of using MRC overother image formats and techniques may include, for example, bettercompression ratio, better data information retention, smaller file size,and or relatively better image quality among others.

In step 930, the intermediate output data is transmitted to the outputdevice 220 or output system 250 for further processing and final output.The transmission of the intermediate output data may be accomplishedthrough wireless or wired communication links between the informationapparatus 200 and the output device 220 and can be accomplished throughone or multiple sessions.

In step 940, the output device 220 or output system 250 receives thetransmitted intermediate output data. The output device 220 or outputsystem 250 may include an output controller 230 to assist communicatingwith the information apparatus 200 and/or processing the intermediateoutput data. Output controller 230 may have a variety of configurationsand implementations with respect to output device 220 as shown in FIG.7A-7F. Interpretation process 940 may include one or more of parsing,decoding, decompression, decryption, image space conversion among otheroperations if the received intermediate output data requires suchprocessing. An output image is decoded or retrieved from theintermediate output data and may be temporarily stored in a buffer ormemory included in the output device/output system (220/250) or outputcontroller 230 for further processing.

If the intermediate output data includes components with MRC format orencoding techniques, it may contain additional segmented information(e.g. foreground and background), which can be used to enhance imagequality. For example, different techniques or algorithms in scaling,color correction, color matching, image enhancement, anti-aliasing andor digital halftoning among others may be applied to different segmentsor layers of the image information to improve output quality or maximizeretention or recovery of image information. Multiple layers may later becombined or mapped into a single layer. These image processing andconversion components and/or operations can be included in the outputcontroller 230 of present invention.

In step 950, the decoded or retrieved output image from the intermediateoutput data may require further processing or conversion. This mayinclude one or more of scaling, segmentation, interpolation, colorcorrection, GCR, black generation, color matching, color spacetransformation, anti-aliasing, image enhancement, image smoothing and ordigital halftoning operations among others.

In an embodiment where the output device 220 does not include a printercontroller, an output controller 230 or an output device 220 thatincludes output controller, after performing the remaining portion ofRIP operations (e.g. color space conversion and halftoning) on theoutput image, may further convert the output data in step 950 into aform that is acceptable for input to a printer engine for rendering.

In an alternative embodiment where the output device 220 or the outputsystem 250 includes a conventional printer controller, the outputcontroller may simply decodes and or converts the intermediate outputdata (print data in this example) into format or language acceptable tothe printer controller. For example, a printer controller may require asinput a page description language (e.g. PostScript, PCL, PDF, etc.), amarkup language (HTML, XML etc) or other graphics or document format. Inthese cases, the output controller 230 may interpret, decompress andconvert the intermediate print data into an output image that hasoptimal output resolution, bit depth, color space, and output sizerelated to the printer controller input requirements. The output imageis then encoded or embedded into a printer-controller print data (e.g. apage description language) and sent to the printer controller. Aprinter-controller print data is a print data that is acceptable orcompatible for input to the printer controller. After the printercontroller receives the printer-controller print data, the printercontroller may further perform operations such as parsing,rasterization, scaling, color correction, image enhancement, halftoningetc on the output image and generate an appropriate printer-engine printdata suitable for input to the printer engine.

In step 960, the output-engine output data or printer-engine print datagenerated by the output controller 230 or the printer controller in step950 is sent to the output engine or printer engine of the output devicefor final output.

FIG. 10 illustrates a flow diagram of a universal data output process ofthe present invention that includes the raster image processingillustrated with reference to FIG. 9. A universal data output processallows an information apparatus 200 to pervasively output content ordigital document to an output device. The data output process mayinclude or utilize:

-   -   A user interface component and operation where a user initiates        an output process and provides an indication of the selected        output content (e.g. digital document) for output.    -   A client application component or operation that processes the        content indicated for output, and generates an intermediate        output data. The intermediate output data may include at least        partly a raster output image description related to the content.    -   An information apparatus component or operation that transmits        the intermediate output data to one or more selected output        device 220.    -   An output device component (e.g. output controller) or operation        that interprets the intermediate output data and may further        process or convert the output data into a form more acceptable        to an output engine for rendering of the content.

With reference to FIG. 10, a user in step 1000 may initiate theuniversal output method or process 1002. Typically, a user initiates theoutput process by invoking a client application 210 in his/herinformation apparatus 200. The client application 210 may be launched asan independent application or it may be launched from other applications205 (such as from a document browsing, creating or editing application)or as part of or component of or a feature of another application 205residing in the same information apparatus 200. When launched fromanother application 205, such as the case when the client application isa device driver or helper application, the client application 210 mayobtain information, such as the content (e.g. digital document) fromthat other application 205. This can be accomplished, for example, byone or combinations of messages or facilitated through an operatingsystem or a particular object or component model etc.

During output process 1002, a user may need to select one or more outputdevices 220 for output service. An optional discovery process step 1020may be implemented to help the user select an output device 220. Duringthe discovery process step 1020, a user's information apparatus 200 may(1) search for available output devices 220; (2) provide the user with alist of available output devices 220; and (3) provide means for the userto choose one or more output devices 220 to take the output job. Anexample of a discovery process 1020 is described below in greater detailwith reference to FIG. 11.

The optional discovery process 1020 may sometimes be unnecessary. Forexample, a user may skip the discovery process 1020 if he or she alreadyknows the output device (e.g., printer) 220 to which the output is to bedirected. In this case, the user may simply connect the informationapparatus 200 to that output device 220 by wired connections or directlypoint to that output device 220 in a close proximity such as in the caseof infrared connectivity. As another example, a user may pre-select orset the output device or devices 220 that are used frequently aspreferred defaults. As a result, the discovery process 1020 may bepartially or completely skipped if the default output device 220 orprinter is found to be available.

In stage 1030, the client application may interact with output device220, the user, and/or other applications 205 residing in the sameinformation apparatus 200 to (1) obtain necessary output device profileand/or user preferences, (2) perform functions or part of raster imageprocessing operations such as rasterization, scaling and colorcorrection, and/or (3) convert or encode at least partially therasterized content (e.g. digital document) into an intermediate outputdata. The processing and generation of the intermediate output data mayreflect in part a relationship to an output device profile and/or userpreferences obtained, if any. The intermediate output data generated bythe client application 210 is then transmitted through wired or wirelesslocal communication link(s) 240 to the output controller 230 included orassociated with the selected output device 220 or output system 250. Anexemplary client application process is described in greater detail withreference to FIG. 12.

In step 1040, the output controller 230 of present invention receivesthe intermediate output data. In the case where the selected outputdevice 230 does not include a printer controller, the output controller230 of present invention may further perform processing functions suchas parsing, interpreting, decompressing, decoding, color correction,image enhancement, GCR, black generation and halftoning among others. Inaddition, the output controller 230 may further convert or conform theintermediate output data into a form or format suitable for the outputengine (e.g. printer engine in the case of a printer). The generatedoutput-engine output data from the output controller is therefore, ingeneral, device dependent and acceptable for final output with theoutput engine (or the printer engine in case of a printer) included inthe selected output device 220 or output system 250.

In the case where the selected output device 220 is a printer, and whenthe printer includes or is connected to a printer controller, the outputcontroller 230 may generate the proper language or input format requiredto interface with the printer controller (referred to asprinter-controller print data). The printer controller may for examplerequire a specific input such as a page description language (PDL),markup language, or a special image or graphics format. In these cases,the output controller 230 in step 1040 may interpret and decode theintermediate output data, and then convert the intermediate output datainto the required printer-controller print data (e.g. PDL such asPostScript or PCL). The printer-controller print data generated by theoutput controller is then sent to the printer controller for furtherprocessing. The printer controller may perform interpretation and rasterimage processing operations among other operations. After processing,the printer controller generates a printer-engine print data suitablefor rendering at the printer engine.

In either case, the output controller 230 or printer controllergenerates an output-engine output data that is suitable for sending toor interfacing with the output engine or the printer engine included inthe output device for rendering. The output data may be temporarilybuffered in components of the output device 220. An implementation ofthe output device process 1040 is described in greater detail withreference to FIG. 13.

The steps included in the universal pervasive output process 1002 mayproceed automatically when a user requests output service.Alternatively, a user may be provided with options to proceed, cancel,or input information at each and every step. For example, a user maycancel the output service at any time by, for example, indicating acancellation signal or command or by terminating the client application210 or by shutting down the information apparatus 200 etc

FIG. 11 is a flow diagram of an example of a discovery process 720,which may be an optional step to help a user locate one or more outputdevices 220 for an output job. The discovery process 1020 may, however,be skipped partially or entirely. Implementation of discovery process1020 may require compatible hardware and software components residing inboth the information apparatus 200 and the output device 220. Theinformation apparatus 200 may utilize the client application 210 orother application 205 in this process. The discovery process 1020 mayinclude:

-   -   An information apparatus 200 communicating with available output        devices 220 to obtain information and attributes relating to the        output device 220 and or its services such as output device        capability, feature sets, service availability, quality of        service, condition.    -   An Information apparatus 200 provides the user information on        each available and or compatible output devices 220.    -   A user selects or the client application 210 (automatically or        not) selects one or more output devices 220 for the output        service from the available or compatible output devices 220.

Various protocols and or standards may be used during discovery process1020. Wireless communication protocols are preferred. Wiredcommunication, on the other hand, may also be implemented. Examples ofapplicable protocols or standards may include, without limitation,Bluetooth, HAVi, Jini, Salutation, Service Location Protocol, andUniversal Plug-and-play among others. Both standard and proprietaryprotocols or combination may be implemented in the discovery process1020. However, these different protocols, standards, or combinationshall not depart from the spirit and scope of present invention.

In one implementation an application (referred here for simplicity ofdiscussion as a “communication manager,” not shown) residing in theinformation apparatus 200 helps communicate with output device 220 andmanages service requests and the discovery process 1020. Thecommunication manager may be a part of or a feature of the clientapplication 210. Alternatively or in combination, the communicationmanager may also be a separate application. When the communicationmanager is a separate application, the client application 210 may havethe ability to communicate, manage or access functionalities of thecommunication manager.

The discovery process 1020 may be initiated manually by a user orautomatically by a communication manager when the user requests anoutput service with information apparatus 200.

In the optional step 1100, a user may specify searching or matchingcriteria. For example, a user may indicate to search for color printersand or printers that provide free service. The user may manually specifysuch criteria each time for the discovery process 1020. Alternatively orin combination, a user may set default preferences that can be appliedto a plurality of discovery processes 1020. Sometimes, however, nosearching criteria are required: the information apparatus 200 maysimply search for all available output devices 220 that can provideoutput service.

In step 1101, information apparatus 200 searches for available outputdevices 220. The searching process may be implemented by, for example,an information apparatus 200 (e.g. with the assistance of acommunication manager) multi-casting or broadcasting or advertising itsservice requests and waiting for available output devices 220 torespond. Alternatively or in combination, an information apparatus 200may “listen to” service broadcasts from one or more output devices 220and then identify the one or more output devices 220 that are needed oracceptable. It is also possible that multiple output devices 220 of thesame network (e.g., LAN) register their services with a control point(not shown). A control point is a computing system (e.g., a server) thatmaintains records on all service devices within the same network. Aninformation apparatus 200 may contact the control point and search orquery for the needed service

In step 1102, if no available output device 220 is found, thecommunication manager or the client application 210 may provide the userwith alternatives 1104. Such alternatives may include, for example,aborting the discovery process 1020, trying discovery process 1020again, temporarily halting the discovery process 1020, or being notifiedwhen an available output device 220 is found. As an example, thediscovery process 1020 may not detect any available output device 220 inthe current wired/wireless network. The specified searching criteria (ifany) are then saved or registered in the communication manager. When theuser enters a new network having available output devices 220, or whennew compatible output devices 220 are added to the current network, orwhen an output device 220 becomes available for any reason, thecommunication manager may notify the user of such availability.

In step 1106, if available output devices 220 are discovered, thecommunication manager may obtain some basic information, or part of orthe entire output device profile, from each discovered output device220. Examples of such information may include, but not limited to,device identity, service charge, subscription, service feature, devicecapability, operating instructions, etc. Such information is preferablyprovided to the user through the user interface (e.g., display screen,speaker, etc.) of information apparatus 200.

In step 1108, the user may select one or more output devices 220 basedon information provided, if any, to take the output job. If the user isnot satisfied with any of the available output device 220, the user maydecline the service. In this case, the user may be provided withalternatives such as to try again in step 1110 with some changes made tothe searching criteria. The user may choose to terminate the servicerequest at any time. In step 1112, with one or more output devices 220selected or determined, the communication link between informationapparatus 200 and the selected output device or devices 220 may be“locked”. Other output devices 220 that are not selected may be dropped.The output process 1020 may then proceed to the client applicationprocess of step 1030 of FIG. 10.

FIG. 12A is a flow diagram of an exemplary client application processwith reference to step 1030 of FIG. 10. A client application process1202 for universal output may include or utilize:

-   -   A client application 210 that obtains content (e.g. digital        document) intended for output.    -   A client application 210 that obtains output device parameters        (e.g. rasterization parameters, output job parameters). One        example of implementation is to obtain the output device        parameters from an output device profile (e.g. printer profile),        which includes device dependent parameters. Such profile may be        stored in an output controller 230, output device 220 or        information apparatus 200.    -   A client application 210 that may optionally obtain user        preferences through (1) user's input (automatic or manual) or        selections or (2) based on preset preference or pre-defined        defaults or (3) combination of the above.    -   A client application 210 that rasterizes at least part of the        content intended for output (e.g. a digital document) according        to one or more rasterization parameters obtained from previous        steps such as through output device profile, user selection,        predefined user preferences, predefined default or standard etc.    -   A client application 210 that generates an intermediate output        data containing at least part of the rasterized image related at        least partly to the content intended for output.    -   A client application that transmits the intermediate output data        to an output device 220 or output controller 230 for further        processing and or final output.

A client application 210 may obtain content (e.g. digital document) 900or a pointer or reference to the content in many ways. In a preferredembodiment, the client application 210 is in the form of a device driveror an independent application, and the content or its reference can beobtained by the client application 210 from other applications 205 inthe same information apparatus 200. To illustrate an example, a user mayfirst view or download or create a digital document by using a documentbrowsing, viewing and or editing application 205 in his/her informationapparatus 200, and then request output service by launching the clientapplication 210 as a device driver or helper application. The clientapplication 210 communicates with the document browsing or editingapplication to obtain the digital document or reference to the digitaldocument. As another example, the client application 210 is anindependent application and it launches another application to helplocate and obtain the digital document for output. In this case, a usermay first launch the client application 210, and then invoke anotherapplication 205 (e.g. document editing and or browsing application)residing in the same information apparatus 200 to view or download adigital document. The client application 210 then communicates with thedocument browsing or editing application to obtain the digital documentfor output.

In another embodiment, the client application 210 itself providesmultiple functionalities or feature sets including the ability for auser to select the content (e.g. digital document) for output. Forexample, the client application 210 of present invention may provide aGUI where a user can directly input or select the reference or path of adigital document that the user wants to output.

In order to perform rasterization operation on content (e.g. digitaldocument) 900, the client application 210 in step 1210 needs to obtaindevice dependent parameters of an output device 220 such as therasterization parameters. Device dependent parameters may be included inan output device profile. A client application 210 may obtain an outputdevice profile or rasterization parameters in various ways. As anexample, an output device profile or rasterization parameters can beobtained with one or combination of the following:

-   -   The client application communicates with an output device 220 to        upload output device profile or information related to one or        more rasterization parameters.    -   The client application 210 obtains the output device profile        from a network node (e.g. server).    -   A user selects an output device profile stored in the user's        information apparatus 200.    -   The client application 210 automatically retrieves or uses a        default profile, predefined standard values or default values        among others.    -   The client application 210 obtains output device parameters by        calculating, which may include approximation, based at least        partly on the information it has obtained from one or        combination of an output device 220, a user, default values, and        a network node.

It is important to note that step 1210 is an optional step. In someinstance, part of or the entire output device profile or related devicedependent information may have been already obtained by the clientapplication 210 during the prior optional discovery process (step 1020in FIG. 10). In this case, step 1210 may be partially or entirelyskipped.

In one implementation, the client application 210 communicates with oneor more output devices 220 to upload output device profiles stored inthe memory or storage components of those one or more output devices 220or their associated one or more output controllers 230. In someinstance, the uploaded output device profile may contain partially orentirely references or pointers to device parameters instead of thedevice parameters themselves. The actual output device parameters may bestored in a network node or in the information apparatus 200, where theycan be retrieved by the client application 210 or by other applications205 using the references or pointers. It should be noted that aplurality of information apparatuses 200 may request to obtain outputdevice profile or profiles from the same output device 220 at the sametime or at least during overlapping periods. The output device 220 orits associated output controller 230 may have components or systems tomanage multiple communication links and provide the output deviceprofile or profiles concurrently or in an alternating manner to multipleinformation apparatuses 200. Alternatively, an output device 220 mayprovide components or systems to queue the requests from differentinformation apparatuses 200 and serve them in a sequential fashionaccording to a scheme such as first come first served, quality ofservice, etc. Multi-user communication and service management capabilitywith or without queuing or spooling functions may be implemented by, forexample, the output controller 230 as optional feature sets.

In another implementation, one or more output device profiles may bestored locally in the information apparatus 200. The client application210 may provide a GUI where a user can select a profile from a list ofpre-stored profiles. As an example, the GUI may provide the user with alist of output device names (e.g. makes and models), each correspondingto an output device profile stored locally. When the user selects anoutput device 220, the client application 210 can then retrieve theoutput device profile corresponding to the name selected by the user.

In certain cases, during a discovery or communication process describedearlier, the client application 210 may have already obtained the outputdevice ID, name, or reference or other information in a variety of waysdescribed previously. In this case, the client application 210 mayautomatically activate or retrieve an output device profile stored inthe information apparatus 200 based on the output device ID, name, orreference obtained without user intervention.

In yet another implementation, the client application 210 may use a setof pre-defined default values stored locally in a user's informationapparatus 200. Such defaults can be stored in one or more files ortables. The client application 210 may access a file or table to obtainthese default values. The client application 210 may also create orcalculate certain default values based on the information it hasobtained during previous steps (e.g. in optional discovery process,based on partial or incomplete printer profile information obtained,etc). A user may or may not have an opportunity to change or overwritesome or all defaults.

Finally, if, for any reason, no device dependent information isavailable, the client application 210 may use standard output andrasterization parameters or pre-defined default parameters. The aboveillustrates many examples and variations of implementation, these andother possible variations in implementation do not depart from the scopeof the present invention.

In step 1220, the client application 210 may optionally obtain userpreferences. In one exemplary implementation, the client application 210may obtain user preferences with a GUI (graphical user interface). Forsimplicity, a standard GUI form can be presented to the user independentof the make and model of the output device 220 involved in the outputprocess. Through such an interface, the user may specify some deviceindependent output parameters such as page range, number of cards perpage, number of copies, etc. Alternatively or in combination, the clientapplication 210 may also incorporate output device-dependent featuresand preferences into the GUI presented to the user. The device-dependentportion of the GUI may be supported partly or entirely by informationcontained in the output device profile obtained through components andprocesses described in previous steps. To illustrate, device dependentfeatures and capabilities may include print quality, color or grayscale,duplex or single sided, output page size among others.

It is preferred that some or all components, attributes or fields ofuser preferences have default values. Part or all default values may behard-coded in software program in client application 210 or in hardwarecomponents. Alternatively, the client application 210 may also access afile to obtain default values, or it may calculate certain defaultvalues based on the information it has obtained during previous steps orcomponents (e.g. from an output device profile). A user may or may nothave the ability to pre-configure, or change or overwrite some or alldefaults. The client application 210 may obtain and use some or alldefaults with or without user intervention or knowledge.

In step 1230, the client application 210 of present invention performsrasterization operation to conform a content (e.g. a digital document),which may includes objects and information in vector graphics, text, andimages, into one or more output images in accordance with therasterization parameters obtained in previous steps. Duringrasterization process, text and vector graphics object or information inthe content is rasterized or converted into image or bitmap formaccording to the given set of rasterization parameters. Imageinformation in the content may require scaling and interpolationoperations to conform the rasterization parameters. Rasterizationprocess may further include operations such as scaling, interpolation,segmentation, image transformation, image encoding, color spacetransformation etc. to fit or conform the one or more output images tothe given set of rasterization parameters such as target output size,resolution, bit depth, color space and image format etc.

In step 1240, the client application 210 generates an intermediateoutput data that includes the rasterized one or more output images. Theintermediate output data of the present invention may contain imageinformation, instructions, descriptions, and data such as color profileamong others. Creating and generating intermediate output data mayfurther include operations such as compression, encoding, encryption,smoothing, segmentation, scaling and or color correction, among others.The image or images contained in an intermediate output data may bevariously encoded and/or implemented with different image formats and/orcompression methods (e.g. JPEG, BMP, TIFF, JBIG etc or combination). Onepreferred implementation is to generate or encode the output image inthe intermediate output data with mixed raster content (MRC)description. The use of MRC in the data output process of presentinvention provides opportunities to improve the compression ratio byapplying different compression techniques to segmented elements in thecontent. In addition, MRC provides opportunities to maintain moreoriginal content information during the encoding process of the outputimage and, therefore, potentially improve output quality.

In step 1250, the client application 210 transmits intermediate outputdata to an output device 220 through local communication link 240. Thecommunication link may be implemented with wired or wirelesstechnologies and the transmission may include one or multiple sessions.

It should be recognized that FIG. 12A illustrates one example of aclient application process 1030 in the data output method 1002 ofpresent invention. Other implementations with more or less steps arepossible, and several additional optional processes not shown in FIG. 12may also be included in the client application process 1030. Use ofthese different variations, however, does not result in a departure fromthe scope of the present invention. As an example, an optionalauthentication step may be included when the selected output device 220provides service to a restricted group of users. Various authenticationprocedures may be added in step 1210 when client application 210 obtainsoutput device profile by communicating with an output device or anoutput controller. As another example, authentication procedures mayalso be implemented in step 1250 when the client application transmitsintermediate output data to one or more output devices 220 or outputcontrollers 230. A simple authentication may be implemented by, forexample, comparing the identity of an information apparatus 200 with anapproved control list of identities stored in the output device 220 oroutput controller 230. Other more complex authentication and encryptionschemes may also be used. Information such as user name, password, IDnumber, signatures, security keys (physical or digital), biometrics,fingerprints, voice among others, may be used separately or incombination as authentication means. Such identification and orauthentication information may be manually provided by user orautomatically detected by the selected output device or devices 220 oroutput controller 230. With successful authentication, a user may gainaccess to all or part of the services provided by the output device 220.The output device profile that the client application 210 obtains mayvary according to the type or quality of service requested ordetermined. If authentication fails, it is possible that a user may bedenied partially or completely access to the service. In this case, theuser may be provided with alternatives such as selecting another outputdevice 220 or alternative services.

Another optional process is that a user may be asked to provide paymentor deposit or escrow before, during or after output service such as step1210 or 1250 with reference to FIG. 12. Examples of payment or depositmay include cash, credit card, bankcard, charge card, smart card,electronic cash, among others. The output controller 220 may providepayment calculation or transaction processing as optional feature setsof present invention.

FIG. 12B illustrates another exemplary client application output process1030 with which an information apparatus 200 can pervasively anduniversally output content to one or more output devices 220 associatedwith or equipped with an output controller 230 of present invention.

The process illustrated in FIG. 12B is similar to the process describedin FIG. 12A except that step 1210, obtaining output device profile, isskipped. In this embodiment, the client application 210 utilizes a setof hard-coded, standard or predefined output device parameters includingrasterization parameters with which the client application 210 canperform rasterization operation and other required image processingfunctions. Users may be provided with the option of changing theseparameters or inputting alternative parameters. Rasterization parametersinclude output size, output resolution, bit depth, color space, colorchannels, scale factors etc. These pre-defined parameters typicallycomply with a specification or a standard. The same specification andstandard may also defined or describe at least partly the intermediateoutput data. Predefined standard parameters can be stored in a file orprofile in an information apparatus 200, an output controller 230,and/or in an output device 220 for easy update or upgrade.

In client output process 1204, since the rasterization parameters arepredefined, the client application 210 may not need to upload printerprofiles from the selected output device 230. Consequently, no two-waycommunication between the information apparatus 200 and the outputdevice or devices 220 is necessary in this process 1204 when comparedwith process 1202 illustrated in FIG. 12A. The client application 210performs rasterization operation 1225 based on standard and/orpredefined parameters and generates a rasterized output image withpredefined or standard properties of those rasterization parameters. Theresulting intermediate output data, which includes at least onerasterized output image, is transmitted from the information apparatus200 to an output device 220 in step 1250 or to its associated outputcontroller 230 for rendering or output. The intermediate output datagenerated in process 1202 in general is less device dependent comparedto the intermediate output data generated in the process 1202 shown inFIG. 12A. The output controller 230 included or associated with theoutput device 220 may be preprogrammed to interpret the raster outputimage, which includes properties or attributes that correspond to thosestandard or predefined parameters.

The standard or predefined rasterization parameters may be hard coded orprogrammed into the client application 210 and/or the output controller230. However, instead of hard coding those parameters, one technique tofacilitate updates or changes is to store those standard parameters in adefault file or profile. The standard or predefined parameters containedin the file or profile can be retrieved and utilized by applications inan information apparatus 200 (e.g. client application 210) and/or byapplications or components in an output device 220 or the outputcontroller 230. In this way, any necessary updates, upgrades or requiredchanges to those predefined or standard parameters can be easilyaccomplished by replacing or modifying the file or profile instead ofmodifying or updating the program, application or components in theinformation apparatus 200, output device 220 and/or output controller230.

A client application process 1204 providing universal output capabilityto information apparatus 200 may include or utilize:

-   -   A client application 210 that obtains content (e.g. digital        document) intended for output.    -   A client application 210 that optionally obtains user        preferences (in step 1220) through (1) user's input (automatic        or manual) or selections or (2) based on preset preference or        predefined defaults or (3) combination of the above.    -   A client application 210 that rasterizes content (in step 1230        or 1225) according to pre-defined or standard rasterization        parameters.    -   A client application 210 that generates intermediate output data        (in step 1240) for rendering or output at an output device 220;        the intermediate output data containing at least partially a        rasterized image related to the content intended for output.    -   A client application 210 that transmits the intermediate output        data to an output device 220 (in step 1250) for further        processing and final output.

One advantage of the client output process 1204 of FIG. 12B compared tothe process 1202 illustrated in FIG. 12A is that the generatedintermediate output data is in general less device dependent. The deviceindependent attribute allows the intermediate output data to be moreportable and acceptable to more output devices equipped or associatedwith output controllers. Both data output processes (1202 and 1204)enable universal output; allowing a user to install a single clientapplication 210 or components in an information apparatus 200 to provideoutput capability to more than one output device 220.

FIG. 13A illustrates one example of an output device process 1302 andits associated raster imaging method of present invention. In thisoutput device process 1302, an output device 220 is capable of receivingan intermediate output data from an information apparatus 200. Theoutput device process 1302 and its operations may include or utilize:

-   -   An output device/system or output controller that receives        intermediate output data (in step 1300). The intermediate output        data includes at least partially a raster output image        describing at least part of the content for rendering at the        output device 220 or system 250.    -   An output device/system or output controller that interprets (in        step 1310) the intermediate output data; in one preferred        embodiment, the intermediate output data includes an output        image utilizing one or more MRC formats or components.    -   An output device/system or output controller that performs image        processing operation (in step 1320) on the raster image. The        image processing operation may include but not limited to image        decompression, scaling, halftoning, color matching, among        others.    -   An output device/system or output controller that converts and        or generates (in step 1330) output-engine output data that is in        a format or description suitable for input to an output engine        (e.g. printer engine in case of a printer) included in an output        device 220.    -   An output engine in an output device 220 that renders or        generates a final output (e.g. the output-engine output data) in        step 1370.

The output device 220 or output system 250 may include an outputcontroller 230 internally or externally to assist the management andoperation of the output process 1302. As shown in FIG. 7, there are manypossible configurations and implementations of an output controller 230associated to an output device 220 Herein and after, output controller230 is regarded as an integral part of the output device to which it isattached. Hence, the following described output device operations may bepartially or completely performed by the output controller associatedwith it.

In step 1300, output device process 1302 is initiated by clientapplication 210 transmitting an intermediate output data to outputdevice 220 or output system 250. In step 1310, the output device 220reads and interprets the intermediate output data, containing at leastone raster output image relating to the content intended for output.During the reading and interpretation process 1310, the output device220 may include components that parse the intermediate output data andperform operations such as decompression, decoding, and decryption amongothers. The output image may be variously encoded and may include one ormore compression methods.

In the event that the method of image encoding includes MRC format,then, in one example implementation, during decoding and mapping of theoutput image in step 1310, the lower resolution layer and information inan image that includes MRC may be mapped, scaled or interpolated to ahigher-resolution output image to produce a better image quality.Therefore, step 1310, in the event that the intermediate output dataincludes MRC component, each layer in an MRC image can be decompressed,processed, mapped and combined into a single combined output imagelayer. Step 1310 may also include scaling, color space transformation,and/or interpolation among others. In addition to the possibility ofmapping methods using different scaling and interpolation ratio withdifferent layers, another advantage of using MRC is that segmentationinformation contained in MRC can be utilized to apply different imageprocessing and enhancement techniques to data in different layers of anMRC image in step 1320.

In step 1320, the output device 220 may further perform image processingoperations on the decoded output image. These image processingoperations may include, for example, color correction, color matching,image segmentation, image enhancement, anti-aliasing, image smoothing,digital watermarking, scaling, interpolation, and halftoning amongothers. The image processing operations 1320 may be combined or operatedconcurrently with step 1310. For example, while each row, pixel, orportion of the image is being decoded and or decompressed, imageprocessing operations 1320 is applied. In another implementation, theimage processing 1320 may occur after the entire output image or a largeportion of the image has been decoded or decompressed.

If the intermediate output data includes MRC component, then in step1320, there are additional opportunities to improve image quality. Animage encoded in MRC contains segmented information that a traditionalsingle layer image format does not usually have. As an example,foreground can be in one layer, and background in another. As anotherexample, chrominance information may be in one layer and luminance maybe in another. This segmented information in MRC may be used to applydifferent or selective image processing methods and algorithms todifferent layers or segments to enhance image quality or retain orrecover image information. Different image processing techniques oralgorithms may include color matching, color correction, blackgeneration, halftoning, scaling, interpolation, anti-aliasing,smoothing, digital watermarking etc. For example, one can applycalorimetric color matching to foreground information and perceptualcolor matching to background information or vice versa. As anotherexample, error diffusion halftoning can be applied to foreground andstochastic halftoning can be applied to background or vice versa. As yetanother example, bi-cubic interpolation can be applied to a layer andbi-linear or minimum distance interpolation can be applied to adifferent layer.

In step 1330, the output device 220 or the output controller 230 mayconvert the processed image (e.g. halftoned) into a form acceptable tothe output engine of output device 220. This conversion step isoptional, depending on the type, format and input requirement of aparticular output device engine (e.g. printer engine in case of aprinter). Different output engines may have different input raster imageinput requirements. As an example different output engines may requiredifferent input image formats, number of bits or bytes per pixel,compression or uncompressed form, or different color spaces (e.g. suchas RGB, CMY, CMYK, or any combination of Hi-Fi color such as green,orange, purple, red etc). Incoming raster image data can be encoded in arow, in a column, in multiple rows, in multiple columns, in a chunk, ina segment, or a combination at a time for sending the raster data to theoutput engine. In some cases, step 1330 may be skipped if the result ofstep 1320 is already in a form acceptable to the output device engine.In other cases, however, further conversion and or processing may berequired to satisfy the specific input requirement of a particularoutput device engine.

It is important to note that the above described processing from step1310 to step 1330 may require one or more memory buffers to temporarilystore processed results. The memory buffer can store or hold a row, acolumn, a portion, or a chunk, of the output image in any of the stepsdescribed above. Storing and retrieving information into and from thememory buffer may be done sequentially, in an alternating fashion, or inan interlaced or interleaved fashion among other possible combinations.Step 1310 to step 1330 operations can be partially or completelyimplemented with the output controller 230.

In step 1370, the output device engine included in the output device 220or output system 250 receives the output-engine output data generated instep 1330 or step 1320. The output-engine output data is in a form thatsatisfies the input requirements and attributes of the output engine,such as color space, color channel, bit depth, output size, resolution,etc. The output engine then takes this output-engine output data andoutputs or renders the data content through its marking engine ordisplay engine.

One advantage of data output method 1002 that includes output deviceprocess 1302 is that it has less processing requirements on aninformation apparatus 200 compared to conventional process withreference to FIG. 1A, and therefore, enables more information apparatus200 with relatively lower processing power and memory space to haveoutput capability.

For example, some image processing functions, such as halftoning (e.g.error diffusion) may require substantial processing and computing power.In data output process 1002 that includes output device process 1302,halftoning is performed in step 1320 by an output device component (e.g.the output controller 230) included in the output device 220 or theoutput system 250, not in the information apparatus 200; thereforereducing the computational requirements for the information apparatus200. Another advantage of data output 1302 is that the intermediateoutput data is less device dependent than the output data generated byconventional output method 102 with reference to FIG. 1A. The deviceindependence provides opportunity to allow a single driver orapplication in an information apparatus 200 to output intermediateoutput data to a plurality of output devices 220 that include outputcontrollers 230.

Some output devices 220 may contain a printer controller 410. An exampleof this type of output device or printer is a PostScript printer or PCLprinter among others. FIG. 13B illustrates an example of an outputdevice process 1304 with a printer that includes a printer controller410. As discussed in FIG. 1, a printer with a printer controllerrequires input such as page description language (e.g. PostScript, PCLetc.), markup language (HTML, XML etc), special image format, specialgraphics format, or a combination, depending on the type of the printercontroller.

There are many printing system configurations for providing the dataoutput capability and process to a printer or a printing system thatincludes a printer controller. In one example, the existing printercontroller in the output device 220 may incorporate the feature setsprovided by the output controller to form a “combined controller” asdescribed previously with reference to FIGS. 7C and 7F. In anotherexample, the output controller 230 of present invention may be connectedsequentially or cascaded to an existing printer controller; the outputcontroller 230 can be internally installed (with reference to FIG. 7B)or externally connected (with reference to FIG. 7A) to the output device220. For output device 220 that includes a printer controller, theoutput controller 230 may simply decode the intermediate output data instep 1310 and then convert it into a form acceptable for input to theprinter controller in step 1350.

An output device process 1304 and operations for an output device 220 orsystem 250 that includes a printer controller 410 may include orutilize:

-   -   An output controller 230 or components in an output device 220        or system 250 that receives an intermediate print data or output        data (with reference to step 1300), the intermediate print data        includes at least a raster image related at least in part to the        content for rendering at the output device 220.    -   An output controller 230 or components in an output device 220        or system 250 that interprets the intermediate output data (with        reference to step 1310); in one preferred embodiment, the        intermediate output data includes an output image utilizing one        or more MRC format or components.    -   An output controller 230 or components in an output device 220        or system 250 that converts the intermediate output data into a        printer-controller print data (with reference to step 1350); the        printer-controller print data includes a format or language        (e.g. PDL, PDF, HTML, XML etc.) that is acceptable or compatible        to the input requirement of a printer controller.    -   A printer controller or components in an output device 220 or        system 250 that receives a printer controller print data; the        printer controller may parse, interpret and further process        (e.g. rasterization, scaling, image enhancement, color        correction, color matching, halftoning etc.) and convert the        printer-controller print data into a printer-engine print data        (with reference to step 1360); the printer-engine print data        comprising of a format or description acceptable for input to a        printer engine in the output device 220 or the output system        250.    -   A printer engine or components in an output device 220 or system        250 that renders or generates a final output (with reference to        step 1370) with the input printer engine print data.

In output device process 1304, step 1300 (receiving intermediate outputdata) and step 1310 (interpret intermediate output data) are identicalto step 1300 and step 1310 in output device process 1302, which havebeen described in previous sections with reference to FIG. 13A.

In step 1350, the output controller 230 converts the intermediate printdata into a printer-controller print data that is in a form compatibleor acceptable for input to a printer controller. For example, a printercontroller may require as input a specific page description language(PDL) such as PostScript. The output controller 230 then creates aPostScript file and embeds the output image generated or retrieved instep 1310 into the PostScript file. The output controller 230 can alsocreate and embed the output image from step 1310 into other printercontroller print data formats, instructions or languages.

In step 1360, the printer controller receives printer-controller printdata generated in step 1350 that includes an acceptable input languageor format to the printer controller. The printer controller may parse,interpret, and decode the input printer-controller print data. Theprinter controller may further perform raster image processingoperations such as rasterization, color correction, black generation,GCR, anti-aliasing, scaling, image enhancement, and halftoning amongothers on the output image. The printer controller may then generate aprinter-engine print data that is suitable for input to the printerengine. The type and or format of printer-engine print data may varyaccording to the requirement of a particular printer engine.

It is important to note that the above described process from step 1310to step 1360 may require one or more memory buffer to temporarily storeprocessed results. The memory buffer can store or hold a row, a column,a portion, or a chunk, of the output image in any of the steps describedabove. Storing and retrieving information into and from the memorybuffer may be done sequentially, alternated, or in an interlaced orinterleaved fashion among other possible combinations. Process andoperations of step 1310 to step 1360 can be implemented with outputcontroller 230.

In step 1370, the printer engine included in the output device 220 oroutput system 250 generates or renders the final output based on theprinter-engine print data generated in step 1360. For example, theprinter-engine print data may be in CMY, CMYK, and RGB etc, and this maybe in one or more bits per pixel format, satisfying the size andresolution requirement of the printer engine. The printer engineincluded the output device 220 may take this print data and generate orrender an output page through its marking engine.

Having described and illustrated the principles of our invention withreference to an illustrated embodiment, it will be recognized that theillustrated embodiment can be modified in arrangement and detail withoutdeparting from such principles. In view of the many possible embodimentsto which the principles of our invention may be applied, it should berecognized that the detailed embodiments are illustrative only andshould not be taken as limiting the scope of our invention. Rather, Iclaim as my invention all such embodiments as may come within the scopeof the following claims and equivalents thereto.

Unless the context indicates otherwise, a reference in a claim to thenumber of instances of an element, be it a reference to one instance ormore than one instance, requires at least the stated number of instancesof the element but is not intended to exclude from the scope of theclaim a structure or method having more instances of that element thanstated. Specifically, but without limitation, a reference in a claim toan or one output device or system, to an or one image, or to a or onerasterization parameter is not intended to exclude from the scope of theclaim a structure or method having, including, employing or supplyingtwo or more output devices or system, images or rasterizationparameters.

What is claimed is:
 1. A sound output system that is wirelesslyconnectable to one or more servers over a network for receiving audiooutput data from the one or more servers for outputting or playing thereceived audio output data at the sound output system, the sound outputsystem includes: a voice activated command interface for interactingwith a user, memory storing software or firmware, one or moreprocessors, at least one sound output device or speaker, a microphone,and wireless communication circuitry for wireless communication;wherein, when the one or more processors execute at least part of thesoftware or firmware at the sound output system, the sound outputsystem: (1) wirelessly receives, using the wireless communicationcircuitry of the sound output system, data from a portable wirelessdevice via a short range wireless communication link, the portablewireless device being a distinct device from the sound output system;(2) processes an authentication procedure, at the sound output system,by detecting identification information or other information provided bythe portable wireless device via the short range wireless communicationlink, and wherein, subsequent to processing the authenticationprocedure, the sound output system further: (3) establishes, using thewireless communication circuitry at the sound output system, a wirelessconnection to the one or more servers over the network, the networkincludes a wireless local area network; (4) receives, using themicrophone and using the voice activated command interface, a voiceactivated command from the user; (5) sends, using the wirelesscommunication circuitry, a digital content object from the sound outputsystem to the one or more servers over the network for processing atleast part of audio digital content included in the digital contentobject, the sending of the digital content object is based on havingreceived the voice activated command from the user; (6) receives, usingthe wireless communication circuitry, audio output data from the one ormore servers over the network, the audio output data includes audio dataor sound data for output or playing at the sound output system, and theaudio output data having a relationship, at least in part, to the audiodigital content included in the digital content object sent from thesound output system to the one or more servers; and (7) outputs orplays, using the at least one sound output device or speaker of thesound output system, at least part of the audio output data receivedfrom the one or more servers.
 2. The sound output system according toclaim 1, wherein the portable wireless device is at least one of a smartphone or an Internet pad with a touch sensitive screen interface.
 3. Thesound output system according to claim 2, wherein the sound outputsystem further includes an interface with one or more of a button, adisplay, or other interfaces; wherein, when the one or more processorsexecute at least part of the software or firmware at the sound outputsystem, the sound output system further: (a) provides, via the interfaceof the sound output system, at least an indication related to the soundoutput system; and (b) subsequent to having provided the indication in(a), facilitates, using the wireless communication circuitry, a wirelessdiscovery operation, the wireless discovery operation is for theportable wireless device to wirelessly discover the sound output system.4. The sound output system according to claim 3, wherein, when the oneor more processors execute at least part of the software or firmware atthe sound output system, the sound output system further: (c) transmits,using the wireless communication circuitry, at least one of attributeinformation or identification information related to the sound outputsystem to the portable wireless device that has wirelessly discoveredthe sound output system in (b); and (d) subsequent to having transmittedthe at least one of attribute information or identification informationin (c), establishes, using the wireless communication circuitry, awireless communication link between the sound output system and theportable wireless device; and wherein the receiving of the data from theportable wireless device in (1) is received via the wirelesscommunication link established in (d), and wherein the wirelesscommunication circuitry further supports at least a protocol within IEEE802.11 standards or Bluetooth specifications for establishing thewireless communication link between the sound output system and theportable wireless device in (d).
 5. The sound output system according toclaim 2, wherein the wireless communication circuitry includes at leastone wireless communication unit, the least one wireless communicationunit includes one or more chips or chipsets for wireless communication,the one or more chips or chipsets support at least a protocol withinIEEE 802.11 standards for establishing a wireless local area networkconnection that includes the wireless local area network in (3).
 6. Thesound output system according to claim 5, wherein the one or moreservers over the network are operated, at least partly, by a digitalcontent service, the digital content service is for providing digitalcontent to users who have signed up or have subscribed to the digitalcontent service, and wherein the audio output data for outputting orplaying at the sound output system includes audio digital contentreceived from the digital content service, and the digital contentservice is operated, at least partly, over the Internet; and wherein,the sound output system further establishes, using the wirelesscommunication circuitry of the sound output system, a connection to thedigital content service, and wherein the receiving of the audio outputdata is based, at least in part, on having authentication informationfor accessing the digital content service.
 7. The sound output systemaccording to claim 5, wherein, when the one or more processors executeat least part of the software or firmware at the sound output system andsubsequent to establishing the wireless connection in (3), the soundoutput system: (i) downloads, using the wireless communication circuitryand via the wireless connection established in (3), application softwareor software components or data from the one or more servers over thenetwork, the application software or software components or data is forupgrading, updating, or modifying features and capabilities of the soundoutput system; and (ii) installs, using the one or more processors atthe sound output system, the application software or software componentsor data downloaded in (i), and wherein the sending of the digitalcontent object to the one or more servers and the receiving of the audiooutput data from the one or more servers are both facilitated, at leastin part, using the application software or software components or datadownloaded in (i) and installed in (ii).
 8. A method for setting up anoutput system to receive voice activated commands from a user, theoutput system includes: one or more sound output devices for outputtingsound, a microphone, a voice activated command interface for interactingwith the user, and wireless communication circuitry, the method,comprising: (1) establishing, using the wireless communication circuitryat the output system, a short range wireless communication link betweenthe output system and a portable wireless device, the portable wirelessdevice is a distinct device from the output system, and the portablewireless device is at least one of a smart phone or an information pad;(2) receiving, using the wireless communication circuitry at the outputsystem and via the established short range wireless communication link,information from the portable wireless device, and, subsequent to havingreceived the information from the portable wireless device, the methodfurther comprises: (3) coupling the output system to a network using thewireless communication circuitry at the output system, the networkincludes a wireless local area network; (4) accessing, using thewireless communication circuitry of the output system, one or moreservers over the network, the one or more servers providing, at least inpart, a service that is accessible, at least partly, over the Internet;(5) receiving, via the microphone, a voice activated command from theuser, the receiving of the voice activated command is related tooutputting or playing digital content; (6) receiving, via the wirelesscommunication circuitry at the output system, audio output data from theone or more servers, the receiving of the audio output data from the oneor more servers is subsequent to the output system having received thevoice activated command from the user, via the voice activated commandinterface; and (7) outputting or playing, using the one or more soundoutput devices included in the output system, at least part of the audiooutput data received from the one or more servers, wherein the audiooutput data is related to the digital content that includes audio dataor voice data, individually or in any combination.
 9. The methodaccording to claim 8, wherein the output system is embodied, at least inpart, as a speaker or an Internet appliance, individually or in anycombination, and wherein the output system does not include aconventional personal computer, a desktop personal computer, or a laptopcomputer.
 10. The method according to claim 8, wherein the wirelesscommunication circuitry includes one or more chips or chipsets forwireless communication; at least one chip or chipset of the one or morechips or chipsets supporting at least a protocol within IEEE 802.11standards for establishing a wireless local area network connection, andwherein the coupling of the output system to the network includes theoutput system coupling, using the one or more chips or chipsets, to thewireless local area network, and at least one chip or chipset of the oneor more chips or chipsets supporting at least a protocol within IEEE802.11 standards or within Bluetooth specifications for establishing theshort range wireless communication link in.
 11. The method according toclaim 10, wherein the one or more servers are operated, at least partly,by a digital content service, the digital content service is forproviding digital content to users who have signed up or subscribed tothe service, and the method further comprises: obtaining, at the outputsystem, authentication information for accessing the digital contentservice; and wherein the accessing of the one or more servers in (4), bythe output system, includes the output system using, at least in part,the authentication information obtained at the output system, andwherein the authentication information includes one or more of a username, a password, an ID number, a security key, or biometricinformation, individually or in any combination.
 12. The method of claim10, wherein subsequent to accessing the one or more servers, the methodfurther comprises: (i) receiving, via the microphone of the outputsystem, voice activated commands from the user; (ii) sending, from theoutput system and using the wireless communication circuitry, a digitalcontent object to the one or more servers over the network in responseto the voice activated commands received in (i); (iii) receiving, by theoutput system and using the wireless communication circuitry, outputdata from the one or more servers over the network for outputting at theoutput system, the receiving of the output data being in response tohaving sent the digital content object to the one or more servers in(ii); and (iv) outputting or playing, at the output system and using theone or more sound output devices, at least part of the output datareceived in (iii), the at least part of the output data includes audiodigital content or voice digital content.
 13. The method according toclaim 10, wherein the output system further includes an interface; andwherein, prior to establishing the short range wireless communicationlink with the portable wireless device in (1), the method furthercomprises: (a) receiving, by the output system and via the interface ofthe output system, an indication from the user for operating the outputsystem; (b) facilitating, using the wireless communication circuitry ofthe output system, a wireless discovery operation, the wirelessdiscovery operation is for the portable wireless device to wirelesslydiscover the output system, the wireless discovery operation beingsubsequent to having received the indication from the user in (a); (c)transmitting, from the output system and using the wirelesscommunication circuitry, at least one of attribute information oridentification information related to the output system, to the portablewireless device for the user of the portable wireless device to identifyor to select the output system for service; and (d) receiving, by theoutput system and using the wireless communication circuitry, a servicerequest from the portable wireless device based, at least in part, onhaving transmitted the at least one of attribute information oridentification information.
 14. The method according to claim 8, whereinthe wireless communication circuitry includes one or more chips orchipsets for wireless communication that support at least a protocolwithin IEEE 802.11 standards or Bluetooth specifications forestablishing the short range wireless communication link in (1), andwherein the short range wireless communication link established in (1)is one of a direct short range wireless communication link between theoutput system and the portable wireless device or wireless local areanetwork communication between the output system and the portablewireless device.
 15. An output system for receiving voice activatedcommands from a user and for outputting sound, the output systemincludes at least one sound output device, a microphone, an interface,and wireless communication circuitry, wherein the output system isconfigured to: (1) provide, via the interface of the output system, atleast an indication related to the output system; (2) facilitate, usingthe wireless communication circuitry of the output system, a wirelessdiscovery process, the wireless discovery process is for a portablewireless device to wirelessly discover the output system, the portablewireless device is a distinct device from the output system, and thewireless discovery process is based, at least in part, on short rangewireless communication or local area wireless communication between theportable wireless device and the output system; (3) establish, via thewireless communication circuitry of the output system, a wirelesscommunication link between the output system and the portable wirelessdevice that has wirelessly discovered the output system, and theportable wireless device is at least one of a smart phone or aninformation pad having a touch sensitive screen interface; (4)wirelessly receive, by the wireless communication circuitry of theoutput system and over the established wireless communication link,information from the portable wireless device; (5) connect the outputsystem, via the wireless communication circuitry of the output system,to one or more servers over a network that includes a wireless localarea network, the connecting to the one or more servers over the networkbeing subsequent to the output system having established the wirelesscommunication link with the portable wireless device; (6) receive, via avoice activated command interface of the output system, a voiceactivated command from the user; (7) receive, by the output system andvia the wireless communication circuitry, audio output data from the oneor more servers over the network subsequent to having received the voiceactivated command, the audio output data includes at least one of sound,voice, or music, individually or in any combination; and (8) output orplay, using the at least one sound output device of the output system,at least part of the audio output data received from the one or moreservers.
 16. The output system according to claim 15, wherein thewireless communication circuitry of the output system is furtherconfigured to: (a) receive, by the wireless communication circuitry ofthe output system and via the established wireless communication link in(3), information from the portable wireless device, the information isrelated, at least in part, to an authentication procedure processed bythe output system, the authentication procedure includes detecting bythe output system one or more of a name, a password, an ID number, aPIN, biometric information, identification information, or a securitykey, individually or in any combination; and (b) establish, via thewireless communication circuitry, a wireless local area networkconnection.
 17. The output system according to claim 16, wherein the oneor more servers provide a service, at least partly, over the networkthat includes the Internet, and wherein the connecting to the one ormore servers in (5) includes the output system providing to the one ormore servers one or more of subscription information, identificationinformation, security information, or authentication information,individually or in any combination, related to the user; and wherein thewireless discovery process, using the wireless communication circuitry,is based, at least in part, on physical proximity between the portablewireless device and the output system.
 18. The output system accordingto claim 15, wherein the wireless communication circuitry includes oneor more chips or chipsets for wireless communication that support atleast a protocol within IEEE 802.11 standards for establishing thewireless local area network connection in (b), and at least one chip orchipset of the one or more chips or chipsets supports at least aprotocol within Bluetooth specifications or within IEEE 802.11 standardsfor establishing the wireless communication link in (3).
 19. The outputsystem according to claim 18, wherein the wireless communicationcircuitry of the output system is further configured to: (i) wirelesslysend, via the wireless communication circuitry, a digital content objectfrom the output system to the one or more servers over the network, thedigital content object including sound data or voice data, and thesending of the digital content object is in response to having receivedone or more voice activated commands from the user; (ii) wirelesslyreceive, via the wireless communication circuitry and from the one ormore servers over the network, audio output data, the audio output dataincludes audio data or sound data for outputting at the output system,and the receiving of the audio output data is in response to havingwirelessly sent the digital content object to the one or more serversover the network in (i), and (iii) output or play, using the at leastone sound output device of the output system, at least part of the audiooutput data received in (ii).
 20. The output system according to claim18, wherein the output system is embodied as a speaker or an Internetappliance, individually or in any combination, and wherein the outputsystem does not include a conventional personal computer, a desktoppersonal computer, or a laptop computer; and wherein the wirelesscommunication circuitry of the output system is further configured to:(i) transmit, using the wireless communication circuitry, informationrelated to the output system to the portable wireless device for theuser of the portable wireless device to identify or to select the outputsystem for a service; and (ii) receive, using the wireless communicationcircuitry at the output system, a service request from the portablewireless device based on having transmitted the information to theportable wireless device, and wherein the establishing of the wirelesscommunication link between the output system and the portable wirelessdevice is subsequent to having received the service request.